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Physicists are very familiar with forced and parametric resonance, but usually not with self- 
oscillation, a property of certain dynamical systems that gives rise to a great variety of vibrations, 
both useful and destructive. In a self-oscillator, the driving force is controlled by the oscillation 
itself so that it acts in phase with the velocity, causing a negative damping that feeds energy into 
the vibration: no external rate needs to be adjusted to the resonant frequency. A little-known 
paper from 1830 by G. B. Airy provides us with the opening to introduce self-oscillation as a 
sort of "perpetual" motion responsible for the human voice. The famous collapse of the Tacoma 
Narrows bridge in 1940, often attributed by introductory physics texts to forced resonance, was 
actually a self-oscillation, as was the swaying of the London Millennium Footbridge in 2000. 
Clocks are self-oscillators, as are bowed and wind musical instruments. The heart is a "relaxation 
oscillator," i.e., a non-sinusoidal self-oscillator whose period is determined by sudden, nonlinear 
switching at thresholds. We review the general criterion that determines whether a linear system 
can self-oscillate. We then describe the limiting cycles of the simplest nonlinear self-oscillators. We 
characterize the operation of motors as self-oscillation and prove a general theorem about their 
limit efficiency, of which Carnot's theorem for heat engines appears as a special case. We also 
briefly discuss how self-oscillation applies to servomechanisms, Cepheid variable stars, lasers, and 
r*j \ the macroeconomic business cycle, among other applications. 
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I. INTRODUCTION 

My pulse, as yours, doth temperately keep time, 
And makes as healthful music: it is not madness 
That I have uttcr'd 

— Hamlet, act 3, scene 4 

Self-oscillation is the generation of a periodic motion from a source of power that lacks a corresponding periodicity: 
the oscillation itself controls the phase with which the source of power acts on it. Self-oscillation is also known as 
"maintained," "sustained," "self-excited," "self-induced," "spontaneous," "autonomous," and (in certain contexts) 
"hunting" or "parasitic" vibration. 1 The main purpose of this article is to bring self-oscillation to the attention of 
theoretical physicists, to whom it is not usually taught in any systematic way. We shall, therefore, emphasize not only 
its practical importance, including its applications in mechanical engineering, acoustics, electronics, and biomechanics 
(perhaps even in finance and macroeconomics) but also why it is conceptually fascinating. 

Section \H\ introduces the subject by revisiting the hoary question of perpetual motion. The earliest mathematical 
treatment of self-oscillation (at least as far as we have been able to determine) appears in a brief paper published 
in 1830 by G. B. Airy, in which he characterized the vibration of the human vocal chords as a form of "perpetual" 
motion compatible with the laws of Newtonian physics. A discussion of Airy's paper gives us the opportunity to 
introduce the key concepts of positive feedback and negative damping. 

Section Hill stresses, both theoretically and through concrete examples, the distinction between self-oscillation and 
the phenomena — more familiar to theoretical physicists — of forced and parametric resonance. Meanwhile, Sec. [TV] 
underlines the role of feedback in self-oscillators and illustrates important qualitative features of their performance. 
Sections [TT1 - II VI form a self-contained presentation in which the main features of self-oscillation are reviewed at a level 
that should be accessible and interesting to an advanced undergraduate physics student. 

Section [V] characterizes self-oscillation with greater mathematical precision, covering both the linear instability at 
equilibrium and the nonlinear limiting cycles. Although it is also self-contained, the purpose of this section is not to 
provide a thorough recapitulation of the mathematical theory of self-oscillating systems, but rather to illuminate the 
close connection of the study of self-oscillation with control theory, a rich field in applied mathematics of enormous 
relevance to modern technology. 

Section I VII treats motors as self-oscillators, focusing on their ability to convert energy energy inputted at one 
frequency (often zero) into work outputted at another frequency. We state and prove a general result about the 
maximum efficiency attainable by motors, of which Carnot's theorem for heat engines is a special case. The arguments 
made in Sec. IVI C H are, as far as we know, largely original and might provide a somewhat novel perspective on some 
aspects of thermodynamics. 

Section IVIII covers other specific instances of self-oscillation. This is an eclectic selection, intended to underline the 
broad applicability of the concepts covered in this article. The description of lasers as self-oscillators in Sec. IVII CI 
opens questions about the extension of self-oscillation and related concepts to quantum systems (one such system, 
the Josephson junction, is discussed in Appendix |A|) . Section IVII Dl explores the use of the concept of self-oscillation 
in economics and raises broader issues concerning the use of physics-inspired models to describe markets and other 
human organizations. 

Though the presentation is intended to be largely self-contained, important results that are available in standard 
texts are only referenced. The emphasis is on bringing out and organizing key concepts, especially when these are 
not stressed in the literature. We pay particular attention to the flow of energy that powers self-oscillators. This will 
be useful in developing a more concrete physical understanding of self-oscillation than what can be gathered from the 
mathematical treatment usually applied to such phenomena in the theory of nonlinear dynamical systems. 

This is not a historically-oriented review, though historical episodes and curiosities will be discussed when useful in 
guiding or illustrating the conceptual treatment of self-oscillation. Appendix [B] gives a brief overview of the history 
proper. This might help some readers to place the subject in context and to better understand why it has not made 
it into physics textbooks, at least not in the form in which we approach it. Appendix IP points out the sources most 
useful to a physics student wishing to learn the subject systematically. 



1 The variants "self-maintained," "self-sustained," "self-sustaining," and "self-exciting", also occur. This diversity of terminology probably 
reflects the lack of an authoritative textbook treatment of the subject from the point of view of elementary classical physics and wave 
mechanics (see Appendix [Cj , so that researchers tend to use whichever term is more prevalent in their own field. The term "self- 
oscillation" (also translated as "auto-oscillation") was coined by Soviet physicist Aleksandr Aleksandrovich Andronov (1901-1952) 
1-3]. Andronov, a student of Leonid Mandelstam, was a professor at Gorky State University and, later in life, a deputy of the Supreme 
Soviet of the USSR. He and his associates made important contributions to the mathematical theory of the stability of nonlinear 
dynamical systems 
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II. PERPETUAL MOTION 
A. Energy conservation 

Let us begin by considering the old chimera of perpetual motion. The state of a classical system (i.e., of an arbitrary 
machine) may be characterized by an iV-dimensional, generalized-coordinate vector q, with components q{. In the 
Euler-Lagrange formalism of classical mechanics, the equation of motion for the system is expressed as 

dt \dqj % 1 ' 

where the overdot indicates the derivative of qi with respect to time t, and L = T — V is the system's Lagrangian 
(where T is kinetic and V the potential energy, expressed as functions of q, q, and t). If L is not an explicit function 
of time, then, by Eq. ((T|), the energy 

i 

is a constant of the motion, dH/ dt = (see Q for the conditions under which H = T + V) . A perpetual motion 
machine "of the first kind," which would have greater energy every time it comes to a configuration characterized 
by the same q^ ^ , therefore requires a time-dependent Lagrangian. The fundamental laws of Nature are believed to 
be time-independent and energy conservation is the reason usually given why perpetual motion of the first kind is 
impossible. 

B. Irreversibility 

That same argument, however, implies that the machine should run forever, but no machine that runs with constant 
energy has ever been built. The reason is that, even though the Lagrangian of a closed system (such as the Universe 
as a whole) is believed to be time-independent, the Lagrangian of an open system (such as any conceivable machine 
that could be built by humans) will be time-dependent: mechanical energy is lost as heat leaks into the environment, 
causing the machine to wind down. 2 

A cyclic machine that runs merely by absorbing heat from the environment and converting it into useful work is 
called a perpetual motion device "of the second kind" Q • According to Lord Kelvin's formulation of the second law 
of thermodynamics, such a machine is impossible, but this is just the systematic statement of an observed fact (see 
7, 8]). 3 The underlying reason why work can be entirely converted into heat, but heat cannot be purely converted 
into work, concerns the fascinating problem of the "arrow of time," which we cannot deal with here except to say 
that it still presents conceptual difficulties for theoretical physics (cf. flC)l - [l3l ] ) . 

Evidently, energy from the environment may flow into the machine and cause it to do useful work. For instance, 
the water in a stream turns the wheel of a mill and heat from burning coal powers a steam engine. This article shall 
focus on self-oscillation, an important type of externally-powered motion. As we shall explain, self-oscillators are 
characterized by the fact that their own motion controls the phase with which the external power source drives them. 
They are therefore, in a certain sense, self-driven (although not, of course, self-powered). 

C. Overbalanced wheels 

A perennially popular idea for a perpetual motion machine is the "overbalanced wheel," in which weights are 
attached to a wheel in such a way that the turning is supposed to shift the weights and keep the left and right half of 
the wheel persistently unbalanced. Early examples of such proposed devices appear in the work of Indian astronomer 



2 A device whose mechanical energy is exactly conserved is sometimes called a perpetual-motion machine "of the third kind," though 
more commonly the term perpetual motion is reserved for machines that can do useful work, such as pulling up a weight. On the history 
of the concept of "perpetual motion," see [f|. 

3 In the same spirit, Stevinus, the 16th century Flemish mathematician and military engineer, correctly derived the forces acting on 
masses rolling on inclined planes from the assumption that perpetual motion is impossible. He was so proud of his argument that he 
had it inscribed on his tombstone. Feynman jokes that "if you get an epitaph like that on your gravestone, you are doing fine." [^| 
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FIG. 1: "Overbalanced" wheel conceived by Edward Somerset, 2nd Marquess of Worcester, circa 1640 [15|. Though the weights 
on the right always hang farther from the center than the weights on the left, in equilibrium two weights hang vertically in line 
with the wheel's center, while the twenty weights on the left balance the torque exerted by the eighteen weights on the right. 
The drawing is by R. T. Gould (Fig. 14 in [Tjj]) and is used here with permission of his heirs. 

Bhaskara II and French draughtsman Villard de Honnecourt, in the 12th and 13th centuries CE respectively [l4l |. 
Figure [1] shows another such a wheel, conceived in the 17th century by the Marquess of Worcester [lj|. 

That a device of this kind cannot possibly work should be obvious to a modern student, since a machine powered 
by gravity alone must keep lowering its center of mass in order to accelerate or to maintain its velocity in the presence 
of friction. 4 Nonetheless, efforts to construct overbalanced wheels persist even today. 5 

A curious episode was the exhibition of such a machine by German inventor J. E. E. Bessler, alias Orffyreus, in the 
early 18th century, before various political and scientific dignitaries. Orffyreus's mechanism was hidden from view 
by the wheel's casing, but no observer was able to detect a fraud before the inventor himself destroyed the wheel in 
1727, drifting thereafter into obscurity. In an essay on the subject, Rupert T. Gould (a 20th century English naval 
officer and amateur scholar, best remembered for his work on John Harrison's marine chronometers) admits that such 
a device would have required — contrary to its inventor's claims — an external source of power other than gravity, but 
also deems compelling the surviving testimonies of the wheel's successful operation [H|. 6 

D. Voice as perpetual motion 

Towards the end of his discussion of Orffyreus's wheel, Gould quotes extensively from an 1830 paper by mathemati- 
cian and astronomer George Biddell Airy (who succeeded a few years later to the post of Astronomer Royal), rather 
alarmingly titled "On certain Conditions under which a Perpetual Motion is possible" [24j. In fact, Airy's brief paper 
has nothing to do with overbalanced wheels, but is rather an early attempt to understand the operation of the human 



4 See [T3| for an explanation of the non-operation of Worcester's wheel in terms of explicit computation of the torques. 

5 The documentary A Machine to Die For: The Quest for Free Energy, released in 2003 and broadcast by Australian television |17| . 
credulously showcases the work of various fringe researchers, while the few skeptics interviewed fail to adequately communicate any of 
the relevant physical concepts. One of the devices featured is a large overbalanced wheel built by French retired mechanic Aldo Costa 
outside his home in Villiers-sur-Morin fl8l] . That wheel seems notable only for being so large that it can be turned by the wind. 

6 Gould is co-protagonist of the remarkable TV adaptation of Dava Sobel's Longitude [20 ] . itself a modern classic of the history of 
science for a general audience. Onscreen, Gould is portrayed as a sensitive man whose life is disrupted by nervous breakdowns and his 
consuming obsession with restoring Harrison's historic timepieces [2l| . The circumstances of the scandal that cost Gould his marriage 
and his employment in the Royal Navy — which are inevitably more complex than what is represented in the miniseries — are explored 
in detail in |22fl . Gould's credulity about such things as Nostradamus's prophecies (see [3) might disappoint some admirers of the TV 
character. In an essay on the novels of Charles Reade, George Orwell wrote, not without admiration, that their appeal is "the same as 
one finds in R. Austin Freeman's detective stories or Lieutenant-Commander Gould's collections of curiosities — the charm of useless 
knowledge." [H 



6 




FIG. 2: An open tube, shaped like a a rectangular prism, with one of the sides at its end replaced by a flexible membrane 
(drawn in gray). In the lateral view (a) the air flows from left to right, while in the head-on view (b) the air flows out of the 
page. When the air flow starts, the membrane is initially deflected in, away from the horizontal position H . For steady flow, 
the membrane is in equilibrium at A. At B the air pushes it out, while at C the membrane is pulled in. Images adapted from 
Fig. 22 of [U. 



voice, motivated by Robert Willis's pioneering research on that subject (25j. 7 

Consider a long tube, open at both ends, in the form of a rectangular prism, much longer than it is wide and much 
wider than it is tall, with a side at one of the ends replaced by a taut, flexible membrane, as shown in Fig. [2] Without 
air flowing through the tube, the membrane sits flat and horizontal, as represented in the illustration by position H. 
Willis found experimentally that, for a steady airflow past the membrane, there is a position A, slightly below H, 
at which the membrane is in equilibrium. If it sits below that, as in B, the air will push the membrane out. If the 
membrane sits above the equilibrium, as in C, it will be pulled in. 8 It would seem, therefore, that turning on the 
airflow could cause the membrane to oscillate about the stable equilibrium at A. 

If we picture the vocal chords as twin membranes vibrating in a steady air current, how do they draw energy in 
order to sustain that vibration and produce a persistent sound? Why is the vibration not damped out by friction and 
the resistance of the air? Both Willis and Airy noted that the answer must lie in the delay with which the stream of 
air exerts the restorative force that would act if the displacement were fixed. According to Airy, 

Mr. Willis explains this [sustained vibration] by supposing that time is necessary for the air to assume 
the state and exert the force corresponding to any position of the [membrane]: which is ne arly the same 
as saying that the force depends on the position of the [membrane] at some previous time. |24| 

Airy therefore modeled the vocal chords as a harmonic oscillator in which part of the restoring force depends on 
the displacement q at an earlier time: 

q{t) = ~a ■ q{t) -b-q{t-c) (3) 

He then showed, using first-order perturbation theory, that for < b <C a and < c^/a < n, the amplitude of the 
oscillation grows after each period. This is what he identified as "perpetual motion." 

Clearly, the energy of the oscillator described by Eq. ^ is not conserved, because the time-delayed force, — bq(t — c), 
cannot be expressed as the derivative of any potential V(q). This is why the kinetic energy of the oscillator can be 
greater each successive time it passes through the equilibrium position q — 0, as in a perpetual motion machine of 
the first kind. 



E. Delayed action 

If b = in Eq. ([3]) then the force always pulls the oscillator back to its equilibrium position. But if < b <C a and 
< Cy/a < it, then as the oscillator passes through q = the delayed force does not reverse its sign for a while, and 
therefore pushes the oscillator away from equilibrium. The bigger the amplitude of the oscillation, the stronger this 



7 The Rev. Robert Willis (1800-1875) was the first English university professor to do significant research in mechanical engineering, as 
well as a distinguished architectural historian. He was the grandson of Dr. Francis Willis, the eccentric physician who attended King 
George III during his madness. [2^1 

8 It is tempting to explain this pulling in by invoking Bernoulli's theorem, as many elementary texts do when discussing the lift on an 
airplane wing, but such an argument is flawed, for reasons that are clearly explained in [27| ]. 
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pushing grows. Thus, the motion of the delayed oscillator may be understood as an instance of positive feedback: the 
oscillator drives itself, leading to an exponentially growing amplitude. 9 

Note that this positive feedback is greatest for c^fa = tt/2. This is both because \q(t — c)| is at its maximum when 
q = and because the time-delayed force always pushes in the same direction in which the oscillator is moving. 

In the mid-19th century, Hclmholtz invented a "fork-interrupter," in which a steel tuning fork rings persistently as 
the movement of one of its prongs switches an electromagnet on and off [29j . Lord Rayleigh, who appears to have 
been unaware of the work by Willis and Airy that we have summarized in Sec. Ill Dt echoes their insight early in his 
monumental treatise on acoustics, The Theory of Sound (first published in 1877), when he explains that Helmholtz's 
fork-interrupter is a "self-acting instrument," whose operation is "often imperfectly apprehended," and that "any 
explanation which does not take account of the retardation of the [magnetic force with respect to the position of the 
prong] is wholly beside the mark." [301) Doorbell buzzers work on this same principle. 10 

Green and Unruh point out in [331 ] an even more elementary example of a self-oscillation associated with a time- 
delay: the audible tone produced by blowing air across the mouth of a bottle. The resulting tone is sustained because 
of the delay in the adjustment of the airflow in the neck of the bottle to the oscillating pressure inside. This allows 
more air to be drawn in when the internal pressure is high and less air to be drawn in when the internal pressure is 
low, thus feeding energy into the oscillation of the pressure. 11 



F. Negative damping 

For small c (i.e., < c^/a -C 1), Eq. ([3]) can be written as a negatively damped linear oscillation: 

q - lq + uj 2 q = , (4) 

where u> 2 = a + b and 7 = be. Negative damping corresponds to a component of the force acting in phase with the 
velocity q. The faster the oscillator moves, the more it is pushed along the direction of its motion. The oscillator thus 
keeps drawing energy from its surroundings. 12 The amplitude of the oscillation grows exponentially with time, until 
it becomes so large that nonlinear effects become relevant and somehow determine a limiting amplitude. It is this 
which gives a regular self-oscillation. 

At the end of Sec. HID I we pointed out that the positive feedback in Eq. is maximal when Cy/a = tt/2. In that 
case, even though c is not small, the resulting motion may be described by Eq. ((4]), with 7 = 6 and lu 2 = a, since for 
sinusoidal motion — q has a phase of — tt/2 relative to q. 

Sclf-oscillation describes not just the human voice, but also clocks, bowed and wind musical instruments, the 
heart, motors, and the theory of lasers, among other important kinds of mechanical, acoustic, and electromagnetic 
oscillations. Surprisingly, one searches the modern textbook literature in theoretical physics (both elementary and 
advanced) largely in vain for discussion of this interesting and important phenomenon. 13 



9 Feedback is commonly thought of as the process of taking the output of a system (in this case, the displacement q), subjecting it to 
some processing (in this case, delaying it by c), and then inputting the result back into the system (as represented in this instance by 
the term proportional to q(t — c) in Eq. J3]l)- Pippard suggests that, in general, it might be better to think of feedback as a series of 
cross-links between the elements that c omp ose a dynamical system, which forces the system to behave in the only way consistent with 
the relations dictated by those linkages [28H . Feedback is said to be "positive" when it encourages the deviation of the system from some 
initial state or trajectory, "negative" when it discourages that deviation. 

10 An electrical circuit analogy for the self-oscillation of the vocal chords was worked out in 31], though without reference to the early 
work of Willis and Airy. For a more recent and detailed discussion of tuning fork self-oscillators, see, e.g., [531 ■ 

11 In 1942, Minorsky pioneered the systematic mathematical study of the stability of dynamical systems with finite delays I'{4| . Bateman 
reviews the history of the subject in sec. 3.1 of 35], though he is unaware of the early work of Willis and Airy. Recently, Atiyah and 
Moore have speculated on the possible use of time-shifted equations of motion in relativistic field theories |36( . 

12 Note that Eq. (4} is the equation of motion for the time-dependent Lagrangian L = (q 2 — ui 2 q 2 ) ■ exp(— ft). 

13 Most elementary physics textbooks treat only undamped, damped, and forced linear oscillations. More advanced texts often discuss 
parametric resonance as well (cf. 1 371 III ■■ but when self-oscillation is treated at all it is usually only in the context of a mathematical 
discussion of the limit cycles of the van der Pol equation (cf. l4ll443|Q . a topic that we shall review in Sec. IV B"T1 
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FIG. 3: Diagram of an RLC electric circuit used as a bandpass filter. The amplitude of V ou t is maximized when the angular 
frequency of Vin is close to f / \/ LC. [ill ] 



III. SELF-OSCILLATION VERSUS RESONANCE 



A. Forced resonance 



Self-oscillation is distinct from the conceptually more familiar phenomenon of forced resonance. In the case of a 
forced resonance, the damping is positive and there is a time-dependent driving term on the right-hand side of the 
equation of motion: 

p Q 

q + -yq + v q = — cos {oj d t) . (5) 
m 

The driving force produces a maximum amplitude of oscillation when the driving frequency uid is tuned to match 
the natural frequency wo of the undriven oscillator. Even in the linear regime, the amplitude of a resonant oscillator 
diverges only if the damping vanishes. Furthermore, the amplitude of an undamped forced resonator diverges linearly 
with time (see [HI); not exponentially like the amplitude of a linear self-oscillator. 

A popular classroom demonstration of forced resonance is to shatter a wine glass by playing its resonant note loudly 
enough on a nearby speaker. An ordinary radio tuner works by having the listener adjust the resonant frequency of 
an LC circuit to match the frequency at which the desired radio station is being broadcast, so that the corresponding 
signal drives the circuit resonantly. The radio tuner is an example of a bandpass filter (i.e., a device that allows only 
frequencies in a narrow band to pass through it), as represented by Fig. [3j 



B. Work on oscillator 



In general, the net energy that an oscillator gains over a complete period r of its motion is 

W„ c t = / dtqF , (6) 

where F is the external force. Thus, if 



and 



then 



F = F cos (u d t) (7) 
q = A cos (ujdt — cj)) (8) 
W n et =7rAF o sin0 , (9) 



so that energy can steadily flow into the oscillator only if the relative phase between the external force and the 
oscillation is < <p < The most efficient transfer of power occurs when cj) = tt/2, when F leads q by a quarter of 
a period. For a forced resonator this only happens when u>d = wo- Moreover, if 7 = in Eq. ([5]), then sin</> = for 




FIG. 4: Photograph of the first suspension bridge over the Tacoma Narrows (part of Washington state's Puget Sound) showing 
the large twisting motion of the bridge's central span just before it collapsed on November 7, 1940. Even during construction, 
the bridge had earned the nickname "Galloping Gertie" because of its oscillation during the frequent high-wind conditions of 
the Narrows. The picture is from [50J and is used here with the permission of the University of Washington's Department of 
Civil and Environmental Engineering. 

all uid 7^ wo (see (46[). On the other hand, for a self-oscillating equation of motion such as Eq. ^ the phase shift is 
automatically 4> = 7r/2 by virtue of the form of the negative damping term —jq. We will have much more to say in 
this article about how such a negative damping can arise in an actual physical system. 

For an undamped forced resonator, the magnitude of F$ in Eq. ^ is fixed, as given by the inhomogeneous term in 
Eq. ([5]). Thus, by Eq. ([9]) and using the fact that the energy E is proportional to the square of the amplitude A, 



■ E WnetWd ,n 

A oc —== oc oc A 

sfE a 



(10) 



which implies that A grows linearly in time. On the other hand, in a self-oscillator as described by Eq. (U), F — jmcOdA 
scales linearly with A, so that 



A<x A 



(11) 



giving an exponential growth of the amplitude. Thus, the exponential increase of A in a linear self-oscillator reflects 
the fact that the motion drives itself. 14 



Flow-induced instabilities 



Many physics texts and popular accounts attribute to forced resonance phenomena that are actually self-oscillatory. 
The most notorious case is the large torsional oscillation ( "galloping" ) that led to the collapse of the suspension bridge 
over the Tacoma Narrows, in the state of Washington, in 1940 (see Fig. 2]). When it fell, the bridge was exposed 
to steady winds of 68 km/h (42 mph). At that wind speed and given the dimensions of the bridge, the Strouhal 
frequency of turbulent vortex shedding was about 1 Hz and therefore could not have been forcing the bridge into an 
oscillation with the frequency observed (and documented in film) of about 0.2 Hz. 15 



Note also that the solutions to Eq. JJ) must be expressible as the real part of a complex exponential, because of linearity and time- 
translation invariance (see |47j): those conditions are broken by the inhomogeneous term in Eq. lf5}. 

The Strouhal frequency, at which a steady flow hitting a solid obstacle sheds turbulent vortices, will be discussed in Sec. IHI El 



10 



) 


\ 

/ 


\ 

1 


K 

s 




\ 


> 


J 

/ 




f 



FIG. 5: Time-lapse pictures of a garden hose self-oscillating. Images by Olivier Doare (ENSTA) and Emmanuel de Langre 
(Ecole Polytechnique) [5^1. [59{. used here with the authors' permission. 



It has been known to engineers, since the earliest investigations of the subject by F. B. Farquharson 16 at the 
University of Washington, and by T. von Karman and L. G. Dunn at Caltech [50], that the catastrophic oscillation 
of the bridge was a flow-induced instability, meaning that it resulted from the coupling between the solid's motion 
and the dynamics of the fluid driving the motion. This is quite unlike a forced resonator, for which there would be 
no back- reaction of the oscillator (the bridge) on the forcing term (the wind). This distinction, as it applies to the 
Tacoma Narrows bridge collapse, is lucidly made by Billah and Scanlan in 51 1, and also by Green and Unruh in [33| . 

Like the actual fluid mechanics responsible for the vibration of the vocal chords, the dynamics of the oscillation 
seen in Fig. [4] is rather complicated and involves turbulent flows; Paidoussis, Price, and de Langre give a thorough 
and modern review of this subject in [52]. For our purposes, it will suffice to note that the "galloping" resulted from 
a feedback between the oscillation of the bridge and the formation of turbulent vortices in the surrounding airflow. 
Those vortices, in turn, drove the the bridge's motion, causing a negative damping of small oscillations, like that of 
Eq. gj). 17 

A more recent case of large and unwanted oscillation of a bridge was the lateral swaying of the London Millennium 
Footbridge after it opened in 2000. This was also a self-oscillation: as pedestrians attempt to walk straight along a 
swaying bridge, they move (relative to the bridge) against the sway, thus exerting a force on the bridge that is in phase 
with the velocity of oscillation. Footbridges with low-frequency, sideways modes of vibration, and a sufficiently large 
ratio of pedestrian load to total mass, are generally susceptible to this instability 54|. The mechanism of the back- 



reaction of the bridge's oscillation on the sideways motion of the pedestrians has been investigated mathematically 
by Strogatz et al. [55j, [56| 

Similar instances of flow-induced self-oscillation include the fluttering of power transmission lines and other thin 
solid objects in high winds [57| and the vibration of an unsupported garden hose when it runs at full blast, as pictured 
in Fig. [5] (sec [58, 59] ) . We will also see how self-oscillation explains the operation of the violin and other bowed string 
musical instruments, wind instruments, the human heart, and motors. Notice that in these cases the medium must 
supply enough energy to sustain the oscillation, but no external rate needs to be tuned in order to produce a large 
periodic motion: the oscillator itself sets the frequency and phase with which it is driven. For instance, when playing 
a note on the violin, there is some minimum velocity at which the bow must be drawn, but drawing it faster only 
makes the same note louder. For the hose of Fig. [5j self-oscillation occurs as long as the velocity of water flow exceeds 



16 In the film footage taken on the day that the bridge fell |4SH a man is seen walking away from an abandoned car, pipe in hand, shortly 
before the bridge collapses under the car. This was Prof. Farquharson, who had come from Seattle that morning to monitor the bridge's 
oscillation. At the last moment he had attempted to rescue a black spaniel, Tubby, that had been left behind in the car when its owner 
had fled on foot. The dog, terrified by the violent motion, merely bit Farquharson in the finger and later perished with the bridge |43l . 

17 In 1907, Rayleigh had reported a similar case of a tuning fork being driven at its resonant frequency by a steady cross-flow of air, even 
though the Strouhal frequency of vortex shedding by that flow did not match the fork's resonant frequency. For this he could find "no 
adequate mechanical explanation" at the time. [53l 
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some threshold (60j . 

Ocean waves are another form of self-oscillation, since they have a well-defined wavelength but are generated by the 
action of a steady wind. 18 Helmholtz [6l| and Kelvin [(32| showed that when the relative velocity of two fluids moving 
in parallel directions exceeds a certain threshold, the surface of separation between them becomes linearly unstable. 
Lamb reviews this "Kelvin- Helmholtz instability" in [63[ . Perturbations of the surface of separation along the normal 
direction then grow exponentially until limited by nonlinearities, as in the other negatively-damped systems that we 
have mentioned. This is how the wind generates waves on the surface of a body of water. [64| 

D. Active versus passive devices 

In the parlance of electronics, a forced resonator is a passive device: it merely responds to the external forcing 
term, the response being maximal when the forcing frequency matches the resonant frequency. A self-oscillator, on 
the other hand, is an active device, connected to a source from which it may draw power in order to amplify small 
deviations from equilibrium and maintain them in the presence of dissipation. (The issues of power consumption and 
efficiency in active devices will be treated in detail in Sec. I VII ) 

Passive devices (such as a mechanical resonator or an electrical transformer) can multiply the amplitude of an 
oscillation. But only an active device can multiply its power, and therefore only an active device can maintain, through 
feedback, a steady alternating output without an alternating input [65;]. Passive devices are, for most purposes, well 
described by linear differential equations, whereas a practical description of active devices requires taking nonlinearities 
into account, as it is the nonlinearities that determine the limiting amplitude of the self-oscillation. 

In general, active devices can be thought of as involving an amplification. For a given input signal qin, the amplifier 
produces an output 

9out = 9 ■ qin , (12) 

where g > 1 is called the "gain." The power to generate g ut does not come from the signal qi n , but rather from an 
external source. An ideal amplifier has a constant g, independent of frequency or amplitude. In practice, amplifiers 
always fail at large amplitudes and frequencies, causing a distortion of the output relative to the input. 
According to Horowitz and Hill, 

devices with power gain [i.e., active devices] are distinguishable by their ability to make oscillators, by 
feeding some output signal back into the input. [65j j 

In other words, active devices can be identified by their ability to self-oscillate. 

E. Violin versus aeolian harp 

Helmholtz was the first to study systematically the physics of violin strings and his results are covered in Tonempfind- 
ungen, his groundbreaking treatise on the scientific theory of music [66| . The key point is that the friction between 
the bow and the violin string varies with the relative velocity between them. When the relative velocity is zero or 
small, the friction is large. As the relative velocity increases, the friction decreases. Thus, the frictional force exerted 
by the bow on the string is modulated in phase with the string's velocity, allowing the bow to do net work over a 
complete period of the string's oscillation (see Eq. ©). 

When the bow is drawn over a violin string, the amplitude of the vibration grows exponentially until it reaches a 
limiting, nonlinear "stick-slip" regime. As Helmholtz observed experimentally, in this regime the waveform for the 
displacement of the violin string is triangular. 19 First, the violin string sticks to the bow and moves at the same 
velocity at which the bow is being drawn. This is represented in Fig. [5] by the motion between A and B. At B 
the string unsticks and moves back to equilibrium, which it passes at C. It continues moving with nearly the same 
velocity until at D it again becomes stuck to the bow. Between A and B the frictional force exerted by the bow on 
the string is positive and large, while between B and D the frictional force is still positive but small. Figure [5] also 



I thank John McGreevy for bringing this point to my attention. 

Helmholtz measured the waveform of Fig. [5] by applying the bow very precisely at a node of a harmonic and observing the displacement 
at another node of that same harmonic, so that the string would vibrate appreciably only at the fundamental frequency. 
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FIG. 6: Waveform for the displacement q(t) of a violin string in the limiting "stick-slip" regime, as first measured by Helmholtz 
[66| . Between A and B the string moves with the bow, while between B and D it moves against the bow. The dashed curve 
shows the waveform that results from increasing the bow's velocity. Image adapted from Fig. 22 in [oTI ]. 




FIG. 7: Illustration of the turbulent vortices generated by a flow of velocity v as it hits a circular obstacle of diameter d, on 
the left. These form a "Karman vortex street" [7^]. The frequency with which the vortices are shed was experimentally found 
by Strouhal to obey Eq. (|13[) . This image is by Cesareo de la Rosa Siqueira; an animated version is available at |http://en. 
wikipedia . org/ wi ki/File : Vortex- street-animation. gif | 



shows that if the bow is drawn faster, the string plays the same note, but with a greater amplitude. Within certain 
limits, the amplitude of the vibration is proportional to the speed of the bow. 20 

In an "asolian harp," one or more wires are stretched and their ends attached to an open frame, which is then 
placed in a location where a strong wind may pass through it. This causes the wires to vibrate and emit audible 
tones. Strouhal [6!| and Rayleigh |70l . r7lj demonstrated that in an asolian harp the wind does not act like a violin 
bow. For starters, the string's motion is perpendicular to the direction of the wind. Furthermore, the tone produced 
does not depend on the length, density, or tension of the wire (which determine its resonant frequency), but only on 
the wire's diameter d and the wind speed v. Strouhal found experimentally that the frequency / of the tone produced 
by the wire was approximately given by 

/ ~ 0.2 • ^ , (13) 

the so-called Strouhal frequency of the shedding of turbulent vortices as a steady wind passes around a circular 
obstacle (see Fig. [7]). 21 Evidently, the aeolian harp is just a forced resonator, in which the frequency of the forcing 
term is given by Eq. (| 13[) . Only when the wind produces an / that happens to be close to the fundamental frequency 
of the corresponding wire — or one of its harmonics — does the aeolian harp ring loudly. 

Unfortunately, the conceptual distinction between the aeolian harp as a forced resonator and self-oscillating musical 
instruments like the flute and the flue-pipe organ is not often made clearly in the literature. For instance, in his 
classic work of scientific popularization, Science & Music, Sir James Jeans describes the operation of a flue-pipe organ 



The generation of a tone when a moist finger is dragged along the rim of a brandy glass works by the same stick-slip mechanism as the 
violin. A very similar phenomenon is seen in traditional Tibetan "singing bowls," which ring audibly when a leather-covered mallet is 
rubbed against the rim; see 68] and references therein. 

For a general flow, the number 0.2 in Eq. fl 13H is replaced by a Maclaurin series in the inverse Reynolds number, R~ 1 = u/(vd) (where 
v is the fluid's kinematic viscosity). The ratio fd/v ~ 0.2 + A/R + 0(1/R 2 ) is called the "Strouhal number" (see [7(1 \f& u3§). 
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as a forced resonator driven by the Strouhal vortex-shedding of the air hitting a sharp edge [76] . This cannot be a 
complete description of its operation, because the Strouhal frequency of Eq. (fT3"j) depends on the velocity of the air, 
which would have to be tuned to the resonant frequency for the corresponding note to be sustained (recall that when 
the forcing and resonant frequencies arc different, a forced resonator with non-zero damping vibrates only transiently 
at the resonant frequency, before reaching a steady state in which it moves with the forcing frequency; see |46j). 

Jeans explains that such wind instruments work because there is a back-reaction of the oscillation of the pressure 
of the air within the pipe upon the Strouhal forcing term, which after some delay causes both of them to move in 
phase. But this back-reaction, which is essential to the operation of the wind instruments in question, is precisely 
what makes them self-oscillators, rather than forced resonators. On the details of the operation of hue-pipe organs, 
see [Zl[7|. 

Note that the vortex shedding of Fig. [7] it itself a self-oscillation, since a regular periodic motion, with frequency 
/ given by Eq. (fTB"]). is generated by the steady flow moving past the solid obstacle. The key difference between an 
asolian harp and a flue-pipe organ is that in the former there is no appreciable back-reaction of the string's vibration 
on the vortex-shedding, whereas in the organ (just as in the galloping of the Tacoma Narrows Bridge), the oscillation 
feeds back on the vortex-shedding. In self-oscillating "aeroelastic flutter," including the motion of the bridge in Fig.|4j 
vortices are shed at the frequency of the fluttering, but the shedding frequency can differ significantly from the value 
of Eq. (|13p because the vortices are generated by the vibration, rather than the other way around (see [5lL I74T]). 22 

F. Parametric resonance 

Consider an equation of motion of the form 

q + LJ 2 (t)q = 0, (14) 

where uj 2 {t) is a periodic function. Even though Eq. ([14"]) ("Hill's equation" [80| ) is linear, it is evidently not time- 
translation invariant, and analytic solutions can be obtained only by approximation. For uj 2 of the form 

oj 2 (t) =w 2 (l + acos(7i)) , (15) 

with a <C 1, small oscillations are seen to grow exponentially in time if the angular frequency 7 is close to 2u>o/n, 
where n is a positive integer. This is the phenomenon of parametric resonance, which is strongest for n = 1. (Equation 
[14] with an ui 2 of the form of Eq. ([TBI is called the "Mathieu equation," after Mathieu's investigations in |8l|.) 

Parametric resonance resembles self-oscillation in that the growth of the amplitude of small oscillations is exponential 
in time, as long as there is some initial perturbation away from the unstable equilibrium at q = 0. On the other hand, 
as in the case of forced resonance, the equation of motion for parametric resonance has an explicit time-dependence. 
A parametric resonator requires the tuning of 7 in Eq. (|15l) to 2wo/n, and it fails altogether for 7 — >• 0. 

An analysis of the flow of energy into a parametric resonator is instructive and will be useful to our discussion of 
the efficiency of self-oscillating motors in Sec. IVII As the simplest instance of parametric resonance, consider a mass 
m hanging from a string of length £q. Let 9 be the angle between the string and the vertical. For small angles, the 
motion of the pendulum is described by 

9+^-9 = 0, (16) 

where g is the gravitational acceleration. Suppose that the string is threaded through a hole in a solid plate above the 
pendulum and that one end of the string is attached to the rim of a wheel with radius r <^ £ , turned by a motor, 
as shown in Fig. |S] When the motor runs, the length £ of the string varies with time, giving an equation of motion 
of the form of Eq. (fl"4]) . 

Why is the pendulum driven most efficiently when this motor turns with twice the angular frequency lhq = \J g /£q 
of the pendulum's free oscillation? Note that even though the full oscillation goes as 

9{t) = 6» cos(w i) (17) 



Even Pippard, who was well aware of the theory of self-oscillation, fails in 77] to make a sufficiently clear distinction between the solid 
driven by the Strouhal vortex shedding without back-reaction on the flow (as in the asolian harp) and aeroelastic self-oscillations driven 
by feedback of the solid motion on the fluid (as in the galloping of the Tacoma Narrows Bridge). 
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FIG. 8: A string is attached to a mass m, while the other end is threaded through a hole in a solid plate above and attached to 
the rim of a small wheel driven by a motor. The turning of the wheel causes a variation of the length I of the pendulum, around 
an average value £o- When the wheel moves with angular velocity 2ljq, where u>o = \f~gJto, the system achieves parametric 
resonance, causing the amplitude of small oscillations to grow exponentially with time. Image adapted from Fig. 5.10 in [85| . 



for small angular amplitude 0q , the vertical component of the pendulum's position, 

£0 2 

y(t)^e(l-cos(9 a cos(uj t)))~^-(l + cos(2u} t)) , (18) 

happens, simply by geometry, to move with twice the frequency loq in Eq. (|17p . The reason why parametric resonance 
for this system is most efficient when driven with angular frequency 2luq is that the motor causes a negative damping 
of y(t), pulling up when the mass is going up and "pushing" down then the mass is going down. 23 

Note that the horizontal position of the mass, x(t), moves with angular frequency uj . A horizontal driving force 
should therefore have frequency loq, as is familiar from the pushing of a playground swing, which corresponds to an 
ordinary forced resonance. It is amusing to note that Japanese children learn to use playground swings by parametric 
resonance: they stand up as the swing approaches its equilibrium position, at the bottom of its arc, and crouch as 
it reaches the top of its arc. This makes the moment of inertia of the swing-child system oscillate with twice the 
frequency of the swinging and causes a faster, more efficient growth of the swinging than the forced resonance method 
favored by Western children. 24 

Although parametric resonance is discussed mathematically in many advanced textbooks on classical mechanics (cf. 
[37l - l40j ). 25 from our point of view the most instructive physical discussion is the one by Pippard in 84]. Because it is 
not very well known, we give here an analysis — very similar to Pippard's — of the energy flow in a simple pendulum 
driven by parametric resonance. 

In an ordinary pendulum, the tension T of the string must obey 

T - mg cos9 = mid 1 , (19) 



3 It is, of course, impossible to push on a mass via a string. But if the string slackens as the mass moves radially outward, this is equivalent 
to pushing it out, from the point of view of energy transfer. 

24 I owe this observation to Take Okui. 

25 Rayleigh treated the subject in [82, 83]. 
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so that, by Eq. ^TTJ) and for 6 < 1, 



///../( 1 + ^ - ^ cos(2w i) ) . (20 ) 



This tension does no work in an ordinary pendulum because it is perpendicular to the mass's velocity. But when the 
motor turns with angular velocity 2wo, it varies the length I of the string, causing an additional velocity 

1 = 2cj r cos(2cj i) (21) 

parallel to the tension and in phase with the oscillating part of Eq. (|2T))) . 26 The motor therefore delivers an instanta- 
neous power 

Pout = Tl (22) 

to the mass. The terms in P out that are linear in cos(2wrji) average to zero over a complete period of the motion, but 
the term quadratic in cos(2wot) gives a total energy input 

Wnet = ^^mgro > (23) 

after a full period. Note that the fact that W nct is proportional to the square of the amplitude 6 of the angular 
oscillation (as opposed to the undamped force resonator, for which W nc t is linear in the amplitude) explains why the 
amplitude grows exponentially; see Sec. lIII Bl Eventually Oq becomes large enough that the small-angle approximation 
fails and new terms must be added to Eq. (|20|) ; these do not vary in phase with cos(2ojoi) and therefore reduce the 
efficiency with which energy is delivered by the motor to the pendulum. 

A more detailed mathematical analysis is needed to account for the parametric resonance at frequencies 2wo/n 
for integers n > 1; see, e.g., the treatment of the Mathieu equation in 39]. At those lower frequencies, parametric 
resonance works by a mechanism similar to the entrainment of higher harmonics in non-linear self-oscillators, which 
will be mentioned in Sees. IIV El and IV B 31 



IV. FEEDBACK SYSTEMS 



A. Clocks 



Mechanical and electronic timekeepers are self-oscillators, sparing the user the need to tune an external driving 
frequency. Pendulum clocks and spring-driven watches, just as much as modern electronic clocks, self-oscillate by 
using positive feedback: the vibration of the device is amplified — usin g an external source of power — and fed back 
to it in order to drive it in phase with the velocity of the oscillation (86l |87|. In other words, clocks are active devices, 
as described in Sec. IIIIDI 

This principle may be illustrated by applying feedback to the electric bandpass filter of Fig. [3] Let 

V in = gV out , (24) 

i.e., let us feed back the output, with a gain factor of g. If the terminal V^ u t consumes negligible current (which is 
possible only if the gain is effected by an active amplifier) it is easy to show that 

Vout + ^#Kut + -p^out = . (25) 

Thus, for g > 1 (i.e., for positive feedback) the damping term is negative and the circuit will self-oscillate with angular 
frequency uj = 1/ v ' LC ' . The limiting amplitude of the oscillation is determined by the nonlinear saturation of the 
amplifier, which reduces the effective g for large voltages. This is the principle on which all electronic clocks operate 

M 27 



Here we have simplified our analysis by imagining that the string is massless and cannot stretch, so that displacing one end causes an 
instantaneous displacement of the other end, without any additional force. In any case, the variation of the tension T induced by the 
action of the wheel will make no net contribution to the energy transfer of Eq. (1231) . 
See 88] for a thorough review of how electronic oscillators are implemented in practice. 
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FIG. 9: A Pearson- Anson flasher, which charges the capacitor C until it reaches a threshold voltage Vt < Vo, whereupon the 
neon lamp discharges rapidly, producing a flash of light. The circuit diagram is shown in (a), while the resulting waveform 
V ut(t) is shown in (b). 

A perplexing philosophical question about time is what defines the notion of regularity by which we evaluate 
physical clocks in order to establish how accurate they are. Why do we time the rotation of the Earth with an atomic 
clock 28 and not the other way around? It would take us too far afield to pursue this seriously, but I submit that any 
reasonable answer must depend on the theoretical concept of linear self-oscillation, as represented by Eq. (|25[) in the 
limit of unit gain, g — > 1 + , when the value of LC can be tied to a quantity that is presumed fixed in our accepted 
description of the fundamental laws of physics. 

B. Relaxation oscillations 

The simplest electronic oscillators are RC circuits in which the driving voltage switches between two fixed levels 
when the output reaches an upper and lower threshold. Conceptually, this is akin to a sandglass, turned over as soon 
as the upper chamber becomes empty. Such devices are known as "relaxation oscillators," because the output relaxes 
to a fixed value — with a time constant given by the value of RC — before the driving voltage switches. The switching 
is done by a "Schmitt trigger," which has j> 1, but whose output voltage is confined between fixed upper and lower 
limits 0, 111- 

An even simpler relaxation oscillator is the Pearson- Anson flasher, which charges a capacitor until its voltage reaches 
a threshold, thereupon causing a neon lamp to discharge the capacitor quickly with an accompanying flash of light 
(94j . This is illustrated in Fig. [9] Relaxation oscillators are useful because of their simplicity, but they are not good 
for precision timekeeping. 29 

A relaxation oscillator like the one shown in Fig. [S]has no resonant frequency, since L — ¥ oo, implying uj — > 0; the 
actual period of oscillation depends on the switching at the thresholds, which fix the amplitude. Relaxation oscillators 
with finite L and C — > oo are also common: for example, an automobile's turn signal relies on an RL circuit connected 
to a steady voltage. A bimetallic conducting strip (called a "thermal flasher") is connected in series with L, so that 
when the current reaches some threshold the strip heats to the point that it bends and opens the circuit. The strip 
then quickly cools and bends back, closing the circuit and starting the cycle again. 

We shall see in Sec. IIV CI that relaxation oscillations can be understood as a particular regime of self-oscillation. 
This will require incorporating into the equation of motion the nonlinearity associated with the switching. 



The second is now denned as "the duration of 9,192,631,770 periods of the radiation corresponding to the transition between the two 
hyperfine levels of the ground state of the caesium 133 atom" |89| . In practice, this is implemented in atomic clocks by the self-oscillation 
of a microwave cavity whose resonant frequency (i.e., the analog of the value of l/V LC in Eq. H25H ) is adjusted to maximize the rate at 
which caesium atoms passing through the cavity undergo the hyperfine transition in question [901 ]. Note that this is not an adjustment 
of the frequency of a driving force to make it match the cavity's resonant frequency: rather, it is the value of the resonant frequency 
that is adjusted to ensure its constancy (see [9l|0. 

Until the development of practical pendulum clocks by Huygens in the late 17th century |95|I . all mechanical timekeepers were relaxation 
oscillators (see [961]). The most sophisticated mechanism of this sort was the "verge and foliot escapement," which became common in 
Europe in the 14th century [97ll . 
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FIG. 10: (a): Circuit diagram for the electronic van der Pol self-oscillator. To obtain the necessary nonlinear properties of the 
diode current, a tunnel diode is biased to a point (Vo, ^o) along its characteristic I- V cur ve where the slope is negative and the 
concavity I"(Vo) is negligible, as shown schematically in (b). Images adapted from [l02t | . 



C. Van der Pol oscillator 



In the 1920s, Dutch physicist Balthasar van der Pol and his collaborators developed a model of electrical self- 
oscillation based on the nonlinear, ordinary differential equation 

V - (a - (3V 2 ) V + uj 2 V = , (26) 

where a, (3, and u> 2 are positive constants [98l4l00l |. This oscillator has a negative damping — aV and its amplitude is 
limited by the nonlinear, positive damping term /3V 2 V. 30 

Van der Pol's self-oscillator may be implemented in the laboratory by using a tunnel diode to apply nonlinear 
feedback to an RLC bandpass. 31 Assuming that a negligible amount of electrical current flows out of the terminal 
V out in the circuit of Fig. HUTa) , 

CVout + Tj^° ut = _ ^diodc • (27) 



If one can contrive to get 



and 



aC rr fiC rr . 

/diode = V in + f^V; 3 + const. (28) 

9 W 



V in = gV out , (29) 

the equation of motion for V ut will have the form of Eq. (|2l)l) . with lj = \ j\jLC. 

In practice, implementing Eq. (|28j) requires biasing the tunnel diode with a voltage source Vo and a current source 
Iq, correspondi ng to an inflection point along the diode's characteristic I-V curve with negative slop e, as shown in 
Fig. HOT b) (see |l02j |). Meanwhile, Eq. (l29l) can be enforced by a simple op- amp multiplier or follower [l04| . 

The steady-state amplitude of oscillation for Eq. ([26]) is 




For that fixed amplitude, the average damping vanishes over a period of oscillation, so that the oscillation can 
be maintained at its natural frequency without net energy either being gained or lost (see [l05f ). For a <C lj, small 



Rayleigh had earli er propos ed an equation of the form q — aq + f}q 3 /3 + ui 2 q = to describe self-oscillators such as clocks, violin strings, 
and clarinet reeds |86l . |101|| . Note that Eq. (1 26 I t can be obtained from Rayleigh's equation by substituting V = q and differentiating. 
In van der Pol's original implementation, the active element in the circuit was a triode vacuum tube. Such devices are now largely 
obsolete, though they are sometimes still used in hi gh-p ower radio frequency (RF) amplifiers and in some audio amplifiers. For a review 
of triode circuits with positive feedback, see, e.g., [103H . 
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oscillations build up to amplitude Vb, while large oscillations decay down to it, as shown respectively by the waveforms 
of Figs.DUa) and (b). 

On the other hand, for a > w, small displacements grow very quickly, causing them to overshoot Vb, whereupon the 
nonlinear term /3V 2 V causes the amplitude to decay back down, until it eventually shoots off in the other direction, 
as shown by the waveform of Fig. [T27a). This produces a cyc le of rapid buildup and slower decay that van der Pol 
identified as a relaxation oscillation [lOOl Il06| (see also [l09] ) . Such an oscillation is periodic but not sinusoidal. 
The period is not 27r/w, but instead is approximately proportional to a/w 2 . As shown in Fig. I12f bh large, energetic 
oscillations decay down to the same limit cycle to which small oscillations build up. 

In electronics, one might be used to thinking of a relaxation oscillation, such as the waveform of Fig. HJb), as a 
linear evolution periodically reset by an external intervention. Perhaps the most interesting conceptual feature of the 
van der Pol equation in the a 3> uj regime is that it incorporates the nonlinear switching of a relaxation oscillator 
into the solution to the equation of motion. 32 A close-up of this switching if shown in Fig. I12f b). In Sec. IV B II we 
shall return to the van der Pol equation and treat in greater de tail t he nature of its limit cycles. 

The term "relaxation os cillat ion" was coined by van der Pol in [l OOt ] , though the practical use of relaxation oscillators 
is very ancient (see, e.g., [l08j ). Van der Pol chose the name on account of the period of being determined by the 
relaxation time (RC or L/R for non-resonant linear circuits) . Friedlander called the same concept Kippschwingungen 
( "tipping oscillation" ) [1091 ] , a term still used in Germany. 

The vortex shedding illustrated in Fig.[7]is a relaxation oscillation of the point of separation of the viscous boundary 
layer of the flow around the solid obstacle (73j . The fact that it is a relaxation oscillation explains why the frequency 
depends of the velocity of the flow (see Eq. (1131) ). 



D. The heart is a self-oscillator 



Already in the second century CE, Galen noted that 

the heart, removed from the thorax, can be seen to move for a con siderable time [...] a definite indication 
that it does not need the nerves to perform its own function. [llC| 

In the 15th century, Leonardo da Vinci captured the same observation succinctly and poetically: 

Del core. Questo si move da se, e non si ferma, senon eternal mente. ("As to the heart, it moves itself, 
and doth never stop, except it be for eternity") [lllj 

This corresponds, in a modern language, to the observation that the heartbeat is a self-oscillation. 

The heartbeat is controlled by the electric potential in the sino-atrial node (SAN), a bundle of specialized cells 
that act as the heart's natural pacemaker and are located in the upper part of the right atrium. Van der Pol and his 



In the parlance of theoretical economics, the van der Pol model "endogenizes" the switching (see Il07l0 . 
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(c) 



FIG. 12: Numerical solution to the van der Pol equation V - 5 (l - V 2 ) V + V = 0, for: (a) V(0) = 0.1 and V(Q) = 0; and 
(b) V(0) = 2.2 and V(0) = —12. These show the sequence of buildups and decays that van der Pol identified as a relaxation 
oscillation [lOOl . 1 106l | . Plot (c) gives a close-up of the waveform (a) as it overshoots Vo = 2 and starts to decay. 



collaborator, Johannes van der Mark, developed a model of the SAN electrical potential as a relaxation oscillation [ll2j . 
By coupling three relaxation oscillators they succeeded in reproducing many of the features of electrocardiograms for 
both healt hy a nd diseased hearts. The model of Eq. (p?o]) is still relevant to the theory of the heart's electrophysiology 
(see, e.g., (l 1 3j ] and references therein). 

The form of the SAN potential is shown schematically in Fig. Q21 Note that, unlike the waveforms in Fig. [T2l the 
SAN potential is not symmetric: the negative decay phase after the switching at the lower threshold (segment AB in 
the solid curve in Fig. IT51) is slower than the positive decay phase after the switching at the upper threshold (segment 
CD in the same curve). 33 We will see how to accommodate this asymmetry mathematically in Sec. IV B"2l 

The rate of the heartbeat is now believed to be regulated primarily by the strength of the "funny current" // (also 
called, rather less bizarrely, the "hyperpolarization-activated" or "pacemaker" current) |l!5l lllof . This // is given 
by an inward flow of positively-charged ions across the cellular membrane. It occurs during the negative decay phase 
(segment AB in Fig. 1131) of the relaxation oscillation of the membrane potential: this phase is known in cardiology as 
"pacemaker" or "diastolic" depolarization. 34 

The increase in If caused by a greater concentrati on o f adrenaline is believed to account for the speeding up of the 
heartbeat when adrenaline is delivered to the SAN |ll7| . The dotted curve in Fig. [13] illustrates how this speeding 
up appears in the waveform for the SAN potential. Conversely, // may be suppressed, and the heartbeat therefore 



Throughout this article, we use the word "threshold" to refer to the level at which nonlinearity causes a rapid switching in a relaxation 
oscillation. This is the standard usage in electronics (see, e.g., 193d). In electrophysiology the word is usually reserved for a diff erent 
concept: the level to which the cellular membrane must be depolarized to trigger the firing of an action potential (see, e.g., In 
Fig. I13l the "thresholds" in the electronic sense are the levels at A and C, while the "threshold" in the electrophysiological sense is the 
level at B. 

Experiments show that the activation of If is fairly gradual, making the switching at A less sharp than shown in Fig. 1 131 (see Ill5l . lll6jp . 
We avoid this complication in the interest of conceptual clarity. 
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FIG. 13: The solid curve schematically represents the waveform for the heart's SAN potential. The potential switches nonlinearly 
at A and C. This switching is followed by slow "decay" phases (corresponding to segments AB and CD). The rest of the 
waveform is composed of rapid "buildup" phases. The dotted curve sho ws t he speeding up of the negative decay phase that 
results from the delivery of adrenaline to the SAN. Image adapted from [l!5j |. 



slowed down, by the use of drugs such as ivabradine [ll6j | . 

A generalization of van der Pol's equation was proposed by FitzHugh jll8| | as a general model of the oscillation of 
the membrane potential of excitable cells (neurons a nd m uscle fibers). Nagumo et al. then implemented FitzHugh's 
equa tions as an electrical circuit with a tunnel diode |l!9j |. 35 For a brief review of this model and its applications, see 
[l2d| |. See [l2ll | for a thorough treatment of the uses of the FitzHugh-Nagumo model in modern neuroscience. We 
will characterize this model in more detail in Sec. IVB41 



E. Entrainment 



Two or more coupled sinusoidal self-oscillators with different o ;'s w ill end up oscillating synchronously, as long 
as the coupling is sufficient to overcome the difference of the w's [122]. This "entrainment" of self-oscillators (also 
called frequency, phase, or mode locking) wa s fir st reported by Huygens in 1665 for a pair of adjacent pendulum 
clocks mounted on the same vertical support [123| . The same phenomenon was investigated experimentally by Lord 
Rayleigh in the early 20th century, using a pair of weakly coupled "fork interrupters" (see Sec. Ill E|) with slightly 
different resonant frequencies [53j . 

Entrainment is possible because the frequency of a nonlinear vibration may be adjusted by varying its amplitude 
(we shall have more to say on t his point in Sec. IV B 31) . The entrainment of self-oscillators is discussed in modern 
mathematical terms in [l05l Il24| . We have already mentioned, at the end of Sec. IIIIE1 how entrainment is important 
to the operation of wind instruments without reeds, such as flue-pipe organs and flutes. 

Entrainment can also cause an oscillator to move with an integer multiple (a "harmonic") of the frequency of the 
othe r. This simply reflects the fact that the response of a nonlinear oscillator in general produces harmonics (see 
[l25| h Sel f-osc illating musical instruments — like pipe organs, clarinets, or the human voice — maintain only harmonic 
overtones [126]. 36 Higher, non-harmonic modes of the free oscillator are usually either not excited (as in the case of a 
bottle, which rings at an almos t pu re frequency when air is blown across the mouth) or entrained so that they become 
harmonic (as in pipe organs) [128| . 37 Entrainment also explains why vowel sounds in human speech are relatively 



FitzHugh called it the "BonhoefTer-van der Pol model" [llgjl which was also the name then used by Nagumo et al. .119], but it is 
universally known today as "FitzHugh-Nagumo." 

Musical instruments that are not self-oscillators are played either by striking or plucking. Of these, string instruments have — to a good 
appr oxim ation — only harmonic overtones because the ends of the string are fixed and must therefore be nodes of any standing wave 
(see 112711 ). Other percussion instruments (e.g., bells, xylophones, drums, cymbals, etc.) give some non-harmonic overtones. The more 
pronounced those overtones are, the less clear the pitch is. 

There do exist certain acoustic self-oscillators, like the air horn and the vuvuzela, in which the higher overtones are not entrained, giving 
noisy, unmusical sounds. 
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easy to identify and produce, since they correspond to timbres given by a f ew harmo nics (called, in this context, 
"formants") produced by the vibration of air in the mouth and nasal cavities [l29l Il30l |. 38 

Relaxation oscillators — whose period is not governed by a resonant frequency — are easier to entrain than sinusoidal 
oscillators. They also exhibit a unique variant of entrainment, in that they can be locked into a subharmonic of the 
driving frequency. Th is phenomenon was discovered by van der Pol and van der Mark, who called it "frequency 
demultiplication" |l33l |. Relaxa tion oscillators can also, in some circumstances, be weakly entrained at a rational 
fraction of the driving frequency [l24j | , or even at an irrational multiple (this last phenomenon, called quasiperiodicity, 
will be relevant to the discussion in Sec. IV B"3l) . 

The entrainment of relaxation oscillators is immensely important in theoretical biology. It explains, for instance, 
why all the potentials of the individual cells in the heart's SAN oscillate in unison, how thous ands of fireflies can 
flash synchronously, and how the daily rhythm that governs the human body is established: see [134| and references 
therein. 

Van der Pol also p ointed out in [l06j the similarity between the coupling of two of h is oscillators (a pro blem he had 
first treated in [l35| ) and the system of nonlinear e quations proposed by Lotka [l36l | and Volterra [l37l | as a model 
of predator-prey populations; see also jl05l Il38l - ll4l| . For recen t popular discussions of the role of entrainment in the 
determination of biological rhythms and other phe nomena, see [l42l Il43| | . For a thorough mathematical treatment of 
entrainment and its modern applications, see [1441 ]. 



F. Chaos 



Another interesting feature of Eq. (|26|) in the relaxation regime (a 3> u>) is that if a forcing term Fq cos(u>dt) is added 
to the right-hand side, then the solutions may, for certain values of a, be chaotic That is, solutions may 

show sensitive dependence on initial conditions, making the precise behavior of the oscillator effectively unpredictable, 
even though it is governed by a deterministic equation. 

Va n der Pol and van der Mark, were probably the first to observe the onset of chaos in a simple nonlinear system 
[l33j |. thou gh th ey did not fully appreciate its significance at the time. Edward Lorenz's famous work on the "Lorenz 
attractor" [1491 ] . which largely inaugurated modern chaos theory, appeared more than thirty years later. 

In Sec. IV B 31 we shall discuss entrainment and chaos of self-oscillators again. First, however, we will introduce 
mathematical tools to characterize them more precisely. In the process, the close connection between the study of 
self-oscillation and control theory will become evident. 



V. CONTROL THEORY 
A. General linear systems 



Let an iV-dimensional system be in equilibrium for q = 0. For small perturbations, the equation of motion may 
usually be approximated by the linear relation 

Mq+Cq+Kq = 0, (31) 

where M, C, and K are real- valued, constant N x N matrices describing, respectively, the masses (or generalized 
inertias), dampings, and elasticities. By linearity and time-translation invariance, the corresponding motion may be 
expressed as 



q(*)=Re (j^Wie^A^J 



(32) 



The complex numbers cti are the roots of the 2iVth-degree polynomial 

det(a 2 M + aC + K) . (33) 



The earliest work on understanding the production of vowel sounds was by the same Robert Willis mentioned in Sec. Ill Dl see 131]. 
Rayleigh quotes Willis at length in 129], describing his work as "remarkable" and as leaving "little to be effected by his successors," 
though Helmholtz and other German scientists who investigated the problem in the mid-19th century were unaware of it. Even more 
unfortunately, Rayleigh's point a bout the entrainment of the formants was ignored by many acousticians in the 20th century. The 
resulting confusion is discussed in |132H . 
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The corresponding time-independent vectors Aj may be found by solving for 

(a?M + «iC + K) A, = (34) 

and are called the "normal modes." The complex weights Wi in Eq. (I3"2l are determined by the initial conditions. 39 

If cti is a root of Eq. (|33| then its conjugate a* will be a root as well (the physical reason for this is that the imaginary 
part of oii corresponds to a periodic motion, which will appear reversed after time-translating by the corresponding 
half-period) . W hen C = 0, conjugate cVs correspond to the same normal mode Aj, which can be chosen to be 
real- valued [l50j ]. Otherwise, complex-conjugating Eq. (|3"4")l tells us that if ay = a* then Aj = A*. 

Whenever the real part of one of the ckj's is positive, the amplitude of the corresponding mode grows exponentially 
with time. This means that the system can self-oscillate in that mode. 

Thomson (the future Lord Kelvin) and Tait were probably the first to draw attention to the signs of the real parts 
of the roots of Eq. Q33p. In the first edition of their Treatise on Natural Philosophy, published in 1867, they noted that 
a root with a positive real part would correspond to "a motion returning again and again with continually in creas ing 
energy through the configuration of equilibrium," which they dismissed this as unphysical perpetual motion [15 lj . 



1. Stability criterion 

Maxwell was the first to study the stability of mechanical systems by examining the conditions for the real parts of 
all the roots to be non-positive. His interest in this question grew out of the practical concern of understanding the 
possible instabilities of mechanical systems in whi ch th e rate of operation of a machine is controlled by a "governor." 
His 1868 paper on the subject, "On Governors" jl52j . is now commonly cited as a founding document of modern 
control theory. 40 

The general stability criterion for linear systems was worked out by Edward Routh in 1877 [l56| and, independently, 
by Adolf Hurwitz in 1895 [l57j . For a single degree of freedom with a second-order equation of motion, the Routh- 
Hurwitz criterion simply states that a linear system is stable if the elastic and the damping term are both non-negative. 
For more complicated linear systems, the criterion is expressed in terms of the non- negativity of a series of determinants 
built from the coefficients in the polynomial in Eq. (|33[) . Batcman reviews the histor y an d the mathematics of this 
problem in 13 51 . In the physics literature, this subject is discussed by Rayleigh in |158| | and, more modernly, by 
Pippard in [159j |. 

A consequence of the Routh- Hurwitz stability criterion is that a linear system cannot self-oscillate if the matrices 
M, C, and K in Eq. (|31[) are all symmetric (i.e., M T = M, etc., where the superscript T indicates matrix transposition), 
unless C has negative eigenvalues. 



To prove this, let us define bilinear forms 



T(v,u) = v T Mu 
F(v,u) = v T Cu 

V(v,u) = v T Ku . (35) 



By Eq. (|34p . for any pair of normal modes Aj . 



a?T(Aj, Aj) + a t F(Aj, Ai) + V(Aj, Aj) = 
tx}T(Ai, Aj) + <>,/'*( A,. A , i + V(Aj, Aj) = . (36) 

For symmetric M, C, and K, the bilinear forms of Eq. (|35p are also symmetric (i.e., T(v, u) = T(u,v), etc.) and 
therefore, by Eq. (f3"6")) . a^j are the two roots of the same quadratic polynomial, so that 



In the modern theoretical physics literature, it is conventional to write — iuj instead of a (see, e.g., |46|0 . 

Huygens had proposed a centrifugal governor for clocks in |153( . His design was later adapted for use in windmills and water wheels 
(see [3510. but the interest of engineers and scientists in mechanical governors and their stability was sparked primarily by the work of 
James Watt, who in 1788 introduced a centrifugal governor into his steam engine design [154H . Mathematician Norbert Wiener coined 
the term cyberne tics after Maxwell's 1868 paper: x.v(i£Qvr)Tr\<; means "steersman" in ancient Greek and is the source of the English 
word "governor" |155|| . 
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As explained in the previous section, we may always choose ctj = a*, Aj = A*. Let Aj = + ibj, for real- valued 
vectors a^ , b^ . The symmetry of the bilinear forms implies that 

2Re(a * } = -TjAf^T) - -TMTrra • (38) 

By the positivity of the kinetic energy, T(v, v) > for any re al-va lued v. It is easy to show that the minimum value 
of F(v, v) for unit v is given by the smallest eigenvalue of C |l 6Qj ] . 

By Eq. (f38|) , a symmetric linear system can therefore only self-oscillate if C has a negative eigenvalue, which is not 
normally the case in mechanical systems. For instance, M. Stone worked out in detail the conditions of instability 
on a generator-governor system and stressed that the possibility of self-oscillation depends on the asymmetry of the 
matrices 

c = (" «)• K = (o ?)■ < 39 > 

where ci^, &i,2, 7, and k are all positiv e Il6ll . Il62| . Stone also simulated such asymmetric linear systems using 
electrical circuits with active components [l6lj . 

2. Gyroscopic systems 

Note that asymmetric couplings in Eq. pip cannot be obtained directly from a time-independent Lagrangian. Such 
asymmetry is possible only if q describes pertu rbations about a time-dependent state (e.g., about the steady rotation 
of the generator considered by Stone in |16l| ). Asymmetric systems can self-oscillate by absorbing energy via the 
underlying motion at q = 0. 

A way of obtaining an anti-symmetric contribution to C is to eliminate a cyclic variable with non-zero momentum. 
As a simple instance of this, consider the case of the heavy symmetric top. Its motion can be described, in terms of 
the usual Euler angles (9, <j>, ip), by the Lagrangian 
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(d 2 + $ sin 2 fl) + y (ip + <j> cos ej 2 - mg£ cos 9 , (40) 



where I± t 3 are moments of inertia, m the mass of the top, g the gravitational acceleration, and i the distance from 
the top's point of contact with the ground to its center of mass. The cyclic variable ip is associated with a conserved 
momentum 

-r =h (V- + 0COS0) =b . (41) 

dip v ' 
By Legendre-transforming in -0, we obtain the reduced Lagrangian (or "Routhian") 



R = L-bib = 



bip=Y (0 2 +0 2 sin 2 6») + b4> cos 6 ~ mgl cos 6- ^ ■ ( 42 ) 



Suppose that the top starts out spinning vertically (9 — 0). Changing variables to 

£ = sin 9 cos <p , ij = sin 9 sin <j> , (43) 
and linearizing, we obtain, up to total derivatives 

R=j{i 2 +V 2 )+^(e+V 2 )-^(^-v() ■ (44) 
Thus, eliminating ip introduced terms of the form 

Jijqiqj , with 7^ ^ 7^ (45) 



41 Evidently, an undamped or positively damped linear system will be unstable if K in Eq. Il31|l has negative eigenvalues. In that case, the 
corresponding roots of Eq. (133 I t are real-valued and the exponentially-growing solutions are not oscillatory. 
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into the effective Lagrangian for linear perturbations about the motion with 9 = and b 2 > 0. Such terms are 
called "gyroscopic" and make an antisymmetric contribut ion t o the damping matrix C. Whittaker describes the 
corresponding theory of vibrations about steady motion in [l64| . 42 
The resulting equations of motion for small tilt are 

Jx| + br} - mgl£ = , . 

hfj - b£ - mglr) = ' 1 ; 



The determinant of Eq. ([55)1 therefore has roots 



1 



±ia= — (b±y f b 2 - Ahmgl) . (47) 

Thus, if the top spins rapidly (b 2 > Alimgi), the vertical axis is stable and the top "sleeps." For b 2 < Alimgi, the 
axis goes into an exponentially-increasing oscillation about the vertical, until non-l inearities limit the amplitude, or 
the top falls down. For the nonlinear dynamics of the frictionless top see, e.g., |l67| . 

The self-oscillation of the tilt is called nutation and is powered by the top's gravitational potential mg£. This 
non-periodic energy may be transformed into nutation because of the top's spinning, but the kinetic energy b 2 /2I 3 
associated with that spinning is conserved (unless friction is taken into account) and does not power the self-oscillation. 



B. Limit cycles 



Linear stability analysis determines whether small perturbation about equilibrium will decay away or grow expo- 
nentially with time. But physical oscillations cannot grow forever. In order to understand the limiting oscillatory 
regime of unstable systems it is necessary to take nonlinearities into account, as we shall do in this section for the 
simplest cases. 43 

Consider an equation of motion of the form 

x + f(x)x + g(x) =0 . (48) 

It will be convenient to define a new variable y = x + F(x), with dF/dx = f(x), so that Eq. (|48p may be re-expressed 
as a system of two first-order differential equations 

* = f-^) . (49) 

v = -g{x) 

This is the Lienard transformation [168j . which is useful for understanding the limit cycles of self-oscillators. It is a 
varia tion of the phase space method pioneered by Poincare for the study of nonlinear differential equations |l69| ; see 
also |l70) . It may also be used to show rigorously that the van d er Pol oscillator always has a unique limit cycle to 
which all solutions tend, regardless of initial conditions (see [l7l| ). 
The vertical isocline curve, defined by 

d y y r*n\ 
— = - = oo , (50) 

dx x 

is given, for the system described by Eq. (|49|) . by 



V = F(x) . (51) 

Note that, for the circuit of Fig. [TU1 the function F corresponds to the characteristic I-V curve of the diode, with the 
inflection point (Vo,io) displaced to the origin. 



See also |l65j . Older sources label terms of the form of Eq. I|45j l as "gyrostatic," following the usage introduced by Kelvin and Tait in 

[Hp. 

This section is the only one whose contents may be found in somewhat similar form in standard physics textbooks (cf. |4lH43lp . But 
the points that we wish to emphasize and to use in subsequent sections are enough unlike the ones covered in those texts that we have 
judged it advisable to review the subject here in some detail. 
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FIG. 14: Solutions to the van der Pol equation x — a (l — x 2 ) x + x = 0, for a = 0.2, represented in the Lienard plane defined 
by the transformation of Eq. (|53[) . for initial conditions: (a) x(0) = 0.1, 7/(0) = —0.02 (i.e., i(0) = 0); and (b) x(0) = 4, 
2/(0) = —0.53 (i.e., i(0) = —4). The dashed blue line is the vertical isocline dy/dx — oo. 



Van der Pol's equation 



Let us consider, in particular, the van der Pol oscillator of Eq. f|26[) . For mathematical convenience, we rescale by 
uj to work with dimensionless quantities (t toj, a — > ot/ui, and x = V \J / a) so that the equation becomes 

x-a(l-x 2 )x + x = . (52) 

By Eq. (|49p . for this equation of motion the Lienard transformation gives 

x = y + a(x- x 3 /3) , g3 - 
y = —x 

The rate of change of the radius r of the trajectory in the Lienard plane is 

d l~^2~\ — 2 xx + yy 

r = — Var + y l = . (54) 

at r 

Using first-order perturbation theory in a -C 1 and averaging over a complete period of the unperturbed system, we 
obtain that 

(r) = ^(4-r 2 ), (55) 

which proves that for a<C 1 the steady-state amplitude is r = 2 (sec Eq. (I5U1) ). Note that Eq. (|55p also establishes 
that for small a this limit cycle is stable and that all trajectories tend towards it. 

Figures fMl a) and (b) show the Lienard trajectories corresponding to the solutions plotted in Figs. fTTTa) and (b), 
respectively. Shown along with the trajectories is the vertical isocline curve y = a(—x + x 3 /3). 

Figure H~4T a) illustrates how small oscillations spiral out towards r = 2, while Fig. [TWb) illustrates how large 
oscillations spiral in to that same limiting radius. In either case the system approaches a nearly circular trajectory, 
corresponding to an approximately sinusoidal limit cycle for x(t). 

For a 3> 1, it is convenient to rescale y — > ay, so that Eq. (|55|) becomes 

x = a (y + x - x 3 /3) ^ 
y = —x/a 

For most values of x and y, we have that \x\ 3> \y\, so that the flow is almost horizontal. Only for \y — x + x 3 /3| ~ 
0(\x\/a 2 ) (i.e., very close to the vertical isocline) are |x| and \y\ of the same order. 

For a = 5, the Lienard trajectory is shown in Fig. fT5Ta): The system starts at a point A, given by x(Q) = 0.1 
and ?/(0) = —0.1 + 0.1 3 /3 ~ —0.1 (i.e., x(0) = 0). It soon develops a large negative x and shoots off almost 
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FIG. 15: Solutions to the van der Pol equation x — a (1 — x 2 ) x + x = 0, for a = 5, represented in the Lienard plane, defined 
by the transformation of Eq. (|56[) . for initial conditions: (a) x(0) = 0.1, y(0) = —0.1 (i.e., x(0) = 0); and (b) x(0) = 2.2, 
3/(0) = —1.05 (i.e., x(0) = —12). The vertical isocline y = —a; + x 3 /3 is indicated by the dashed blue curve. The shaded region 
around it corresponds to values of (x,y) for which \x\ and \y\ are of similar order. Plot (c) is a close-up of (a) around the 
maximum of the oscillation, where the Lienard trajectory crosses the vertical isocline. 

horizontally until it crosses the vertical isocline at point B. The trajectory then approximately follows that isocline 
curve (y = —x + .t 3 /3) for a while, but the isocline has a maximum in y at x = —1, whereas y in Eq. (j56[) cannot 
change sign while x < 0. At C the system therefore re-enters the region of rapid horizontal flow and shoots off in 
the positive x direction, until at D it crosses the vertical isocline on the x > side. The system will continue in a 
limit cycle DEFC : this corresponds to the succession of buildups and decays of the waveform that we had plotted in 
Fig. Ula). 

Figure [T5Tb) shows the trajectory of the same dynamical system, but now starting at x(0) — 2.2 and y(0) = 
-12/5 - 2.2 + 2.2 3 /3 ~ -1.05 (i.e., x(0) = -12). This corresponds to the waveform that we had plotted in Fig. [T27 b). 
The switching in Fig. IT2T c) is seen here as the crossing of the vertical isocline, shown in close-up in Fig. 115( c). 

We can now justify the result, quoted in Sec. IIV C[ that for the van der Pol equation Eq. (|26|) with a <C w the 
period of the relaxation oscillation is approximately proportional to a/ui 2 . The reason is that the Lienard trajectory 
for Eq. (|56[) spends most of its time near the vertical isocline (corresponding to what we have called the "decay" 
phases of the oscillation, represented by segments DE and FC in Fig. HBT a)). where \x\ and \y\ are 0(l/a). The 
length of one of those segments of the trajectory is 0(1). In units in which w = 1, the time that it takes the system 
of execute this part of the trajectory is therefore ~ a. 

As a — > oo the region around the vertical isocline where the trajectory is not horizontal shrinks to zero width. 
Therefore the limit cycle must be composed of two straight horizontal segments (the infinitely fast buildups, indicated 
by segments CD and EF in Fig. llGf a)) and two segments that run infinitesimally close to the vertical isocline between 
its local extrema at y = ±2/3 (i.e., the decays, which determine the period and are indicated in Fig. ll6f a) by segments 
DE and FC). The overshooting of the thresholds x — ±2 (around D and F) thus shrinks to zero. 

Figure [L6lb) gives the waveform for y, which shows the steady decays interrupted by discontinuous switching, 
familiar from RC relaxation oscillators in electronics (see Sec. HVBj) . Note that, if the variable x is identified by the 
voltage V ou t in Fig. ITUTa) then, by Eq. (|5B|) . y is proportional to the current through the inductor. The behavior of y 



27 




(a) (b) 



FIG. 16: (a) Lienard trajectory for the equation x — a (l — x 2 ) x + x — 0, for x(0) = 0.1, y(0) = —0.1 (i.e., i(0) = 0), as 
a — > oo. In the limit cycle DEFC, the segments EF and CD have constant y — ±2/3 respectively, while segments DE 
and FC follow the vertical isocline curve, y = — x + x 3 /3, indicated by the dashed blue curve. Plot (b) shows the value of 
y = x/a — x + x :i /3, as a function of t' = t/a. 



is therefore that of a simple RL relaxation oscillation in which the capacitance has become negligible and the resonant 
frequency has therefore effectively vanished. (This is similar to the "thermal flasher" mentioned in Sec. IIVBI ) 

The period of the relaxation oscillation in the a — ¥ oo limit can be easily calculated by using Eq. ([551) , which gives 



dy 



ydxj 



dx 

dt=^- = -a±^- . (57) 

V x 



For the segments DE and FC of the limit cycle in Fig. ITBT a). dy/dx = — 1 + x 2 , while for segments EF and CD 
dy I dx — 0. The corresponding period is therefore 

f 1 1-x 2 

r = 2a dx — = a(3-21og2) ~ 1.6a , (58) 

J2 x 

(in units in which the resonant frequency uj is 1). Note that Eq. ([58]) implies that as a (the coefficient of negative 
damping) increases, the period r of the oscillation grows, which might appear counterintuitive at first. A larger a 
speeds up the buildup phases (CD and EF in Fig. |16f a)) but these are already very brief in the relaxation regime. 
Meanwhile, the decay phases (DE and FC) become longer if a is increased. 

In general, self-oscillators give a regular output robustly: they approach the same limit cycle regardless of initial 
conditions and transient perturbations. It is this, above all else, which accounts for their technological value, such as 
their use as motors and clocks. 



2. Asymmetric oscillations 

Relaxation oscillations in nature are often asymmetric: for instance, the heart's SAN potential spends more time 
near its lower threshold than near its upper one, as discussed in Sec. IIVDI We can accommodate this asymmetry by 
adding a linear term to f(x) in Eq. f|48|) . Figure [TTl shows the waveform and Lienard trajectory for such a system. 
The asymmetry reflects the displacement of the vertical isocline in the positive x direction. Since y oc x (see Eq. (|56p ), 
the non-horizontal part of the Lienard trajectory is faster just after the switching at the upper threshold (when \x\ is 
large) than just after the switching at the lower threshold (when \x\ is small). In Fig. [T7T b). these are segments DE 
and FC respectively. 

So far we have only considered cases in which the function F(x) in Eq. (1491) is symmetric about its inflection point. 
In the corresponding oscillators, the mechanical energy moves up and down twice during each period (for instance, in 
Fig. [TBTa) it spikes up sharply during the jumps at CD and EF). There is a class of self-oscillators in which F(x) is 
asymmetric and the mechanical energy goes up and down only once during each period. These are called "two-stroke" 
oscillations and were first described in detail in Il72l. 
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FIG. 18: Solution to x + 0.75 (exp(x) — 2) x + x — 0, for x(0) = 0.1, i(0) = 0, represented: (a) as a function of time and (b) in 
the Lienard plane denned by Eq. (|49[) . The vertical isocline y = 0.75(exp(a;) — 2x) is shown as the dashed blue curve. 



An instance of a two-stroke oscillation is given by the limit cycle of Eq. ([4"9"| with g(x) = x and a characteristic 
function 

F(x) = p{e x - 2x) , (59) 

for < p < 1. The nonlinear positive damping exp(x)i is only important for x > 0, while for x < the oscillation is 
almost linear. For p <C 1, the limit cycle is sinusoidal, but for p > 0.4, the asymmetry becomes clear: the oscillator 
undergoes rapid switching only once per period, at a positive threshold, and this is the only time when the oscillator's 
energy peaks. Figure [TBI illustrates this behavior for p — 0.75. 

3. Forced self-oscillators 

The Lienard transformation can also be applied to forced oscillations obeying an inhomogeneous equation of the 
form 

x + f(x)x + g{x) = 4>{t) , (60) 

giving 



f x = y - F(x) 
\y = -g(x) + <j>{t) 



(61) 
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FIG. 19: Solution to x - 0.25 (l - x 2 ) x + x = 2cos(1.4i), for x(0) = 0.1, x(0) = 0, represented: (a) as a function of time (in 
red), with the forcing term 2cos(1.4£) shown as a dashed blue curve, and (b) in the Lienard plane defined by Eq. (|61[l . with the 
vertical isocline indicated by the dashed blue curve. This solution shows entrainment between the oscillator (with a resonant 
angular frequency of 1) and the forcing term (with angular frequency of 1.4). 

where dF/dx = f(x). 

As an illustration of the entrainment behavior discussed in Sec. IIV El consider 

x — a (l — x 2 ) x + x = F n cos (cudt) (62) 

for a — 0.25, u)d = 1-4, and Fo = 2. The plots in Fig. H~9l show that the oscillation is entrained by the forcing term 
after two cycles, and that th ereaft er it moves precisely in antiphase with it, much as Huygens originally reported for 
the pair of pendulum clocks jl23| | . A self-oscillator can also be entrained at an integer multiple ( "harmonic" ) of the 
driving frequency, as was mentioned in Sec. IIV El 

Though the quantitative characterization of entrainment can be cumbersome (see [IM EM EH Ell), the quali- 
tative explanation of the kind of entrainment shown in Fig. [TO] is straightforward: when the relative phase <$> between 
the (nearly) sinusoidal motion of the oscillator and the forcing term in Eq. (|6"2"|) is such that sin</> ^ 0, the external 
force is doing net work on the oscillator (see Sec. IIII B[) and therefore causing the amplitude to vary. Because of the 
nonlinearity, a change in the amplitude also changes its frequency, and for some range of parameters this means that 
the oscillation can adjust itself in response to the external driving force, until it reaches a steady, phase-locked motion. 

In the relaxation regime (a ^> 1) for Eq. (|6"2"|) . x{t) can also be locked into a submultiple uid/n, of the driving 
frequency ( "frequency demultiplication" ) jl33| | . An instance of demultiplication is shown in Fig. 1201 An interesting 
demonstration conducted by van der Pol and his collaborator van der Mark was to have a Pears on- Anson relaxation 
oscillator drive a loudspeaker, and in turn to drive that oscillator at a constant frequency ujd |l73j |. As the capacitance 
in the Pearson- Anson circuit is dialed up, increasing its natural period, the output is locked at successive submultiples 
of u>d, producing a series of discrete tones that sound much like a descending musical scale played on the bagpipes 
(see also [H]). 

During their experiments on frequency demultiplication, van der Pol and van der Mark also noticed that under 
certain conditions the output of the loudspeaker became very noisy. The reason is that, for some values of the 
parameters in Eq. (|62[) . the ratio of the period of the entrained motion to the period of the forcing term becomes 
irrational: this is called the quasiperiodic regime. For large a, the quasiperiodic and the periodic regimes may overlap, 
leading to solutions to Eq. (|62l) that are chaotic, as we mentioned at the end of Sec. IIV El This is the case, e.g., for 
a = 3, ujd = 1-788, and F — 5, as illustrated in Fig. [5T] 

The subject of the onset of chaos in driven nonlinear systems is treated in detail in moder n tex tbooks on dynamical 
systems. See, e.g., the discussion of the Kolmogorov-Arnol'd-Moser (KAM) theorem in Il74l . For an interesting 
discussion of such systems, with an emphasis on their possible use in macroeconomics, see [175| . 

4- FitzHugh-Nagumo model 

As we mentioned in IIV Dl the FitzHugh-Nagumo model of neuronal action potentials [ll8l . Ill9j is of considerable 
significance in modern neuroscience (see |l2l| ). It was introduced by FitzHugh as a simplification of a four- variable 
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FIG. 20: The solution to x — 5 (l — x 2 ) x + x — 2cos(1.6t), for x(0) = 0.1, i(0) = 0, is shown in red. The forcing term 
2cos(1.6t) in shown in dashed blue. The waveform x(t) is locked at a third of the forcing frequency. 





FIG. 21: Solutions to x - 3 (1 



I x + x — 5cos(1.788i) show sensitive dependence to initial conditions. In (a) the waveform 



in solid red starts at a;(0) = 0.1, £(0) = and the one in dotted blue at a;(0) = 0.1, £(0) = 0.01. The chaotic Lienard trajectory 
(with y = x/3 — x + x 3 /3) for the first of those solutions is shown in (b), for < t < 100. The vertical isocline is indicated by 
the dashed blue curve. 



model proposed e arlie r by Alan Hodgkin and Andrew Huxley to account for their observations of the behavior of the 
squid giant axon [176|. (F or that work, Hodgkin and Huxley shared the 1963 Nobel Prize in physiology or medicine 
with Sir John Eccles |177|.) 

Mathematically, the FitzHugh-Nagumo model is characterized by 



x = y — F(x) 
y = -X- cy 



I(t) 



which is equivalent to the second-order, inhomogeous equation 

x + (f(x) + c)x+{x + cF(x)) = cl(t) + I(t) 



(63) 



(64) 



where f(x) — F'(x). This can be easily implemented electrically by adding a resistor in parallel with the inductance L 
in the circuit of Fig. llOf a) and supplying a time- varying current Iq + I(t). Then x corresponds to the voltage V ou t and 
y corresponds to the current flowing from ground through the inductor. As before, F(x) is given by the characteristic 
I-V curve of the tunnel diode. Many authors use the same F(x) as in the van der Pol oscillator: 



F(x) = a(-x + x 3 /3) 



(65) 



In modeling neuronal action potentials, I(t) is usually interpreted as a slowly-varying stimulus current, so that I 
is negligible and the driving is not a significant effect. Rather, what is important is that a steady / 7^ displaces the 
point along the characteristic I-V curve of Fig. [TUJb) about which the circuit operates. 
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FIG. 22: Solution to the FitzHugh-Nagumo equation (Eq. ([63])) for F(x) = x 3 — 3x and c = 0.1, as I is reduced by steps for size 
5, starting from I = 10, at time intervals of 30. Plot (a) shows the waveform for x(t). Plot (b) shows the Lienard trajectory, 
with the horizontal isocline and the successive vertical isoclines shown in dashed blue. 

In Eq. (|63[) . the equilibrium point x = y = is given by the intersection of the vertical isocline y — F(x) — I with 
the horizontal isocline y = —x/c. For c > 0, the stimulus current / displaces that equilibrium away from the inflection 
point (authors usually choose a c small enough so that the horizontal isocline can intersect the vertical isocline only 
once, always giving a single equilibrium). This displacement makes the oscillation asymmetric, for the same reason 
described in Sec. lVB^l For sufficiently large |J|, the equilibrium is displaced to a point along the characteristic curve 
where the slope is positive and self-oscillation therefore ceases, since the linear damping term is no longer negative 
and the corresponding equilibrium is therefore stable. 

In this way, the model captures the ability of neuronal firing to be turned on and off. Note that the introduction of 
the term — cy in the expression for y in Eq. (|63p . which corresponds to adding a resistor in parallel with the inductor 
in the circuit of Fig. fTOT a). is what allows one to adjust the point of operation along the diode's characteristic curve 
by varying the current Iq without having also to adjust the voltage Vq of the battery. 

Figure [22] illustrates how the relaxation oscillation turns on and off, and how the asymmetry of the oscillation 
changes, as the value of the stimulus current / is varied. In Fig. 1227 a). the waveform for x(t) is plotted as / is 
successively stepped down from 10 to 5 (at t = 30), from 5 to (at t = 60), from to -5 (at t — 90), and from -5 to 
-10 (at t = 120). The same oscillation is shown as a trajectory in the Lienard plane in Fig. I2"27b), where the straight 
horizontal isocline y = —lOx and the successive vertical isoclines y = x 3 — 3x — I are plotted as dashed lines. The 
points marked A and B are stable equilibria, corresponding to the non-oscillatory phases of the waveform for x(t), 
when / = ±10 respectively. 

5. Poincare-Lyapunov stability analysis 

Poincare [l78j | and Lyapunov jl79l | formulated stability analysis — including the stability at a point and the sta- 
bility of time-dependent trajectories such as limit cycles — in a more sophisticated mathematical language, based 
on Poincare's phase space method for the study of nonlinear differential equations. It is this formulation which is 
most familiar to scientists today. See |l70l | for a brief summary of this work. Arnol'd gives a p articularly readable 
presentation of this subject i n his rem arkable textbook on ordinary differential equations [l80j . Other treatments 
written for physicists include jl8ll . Il82l | . 
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The physics involved is essentially the same as in the older Routh-Hurwitz analysis; it is even possible that the 
mathematical elegance and rigor introduced by Poincare and Lyapunov might have helped divert the attention of 
physicists away from the energetic considerations that we stress in this article. Since the topic is well covered in the 
standard physics literature, we shall not comment on it further. 

VI. MOTORS 

Andronov, Vitt, and Khaiki n, de fined self-oscillation as the production of "a periodic process at the expense of a 
non-periodic source of energy" [183j. Only a regular periodic motion is technologically useful, but most of the sources 
of power provided by nature are steady or slowly varying with respect to the time scales relevant to human technology. 
Therefore self-oscillators, which turn a steady input into an alternating output, are essential to engineering. 

A. Turbines 

The oldest and still the most important motors are turbines, which use a steady flow to drive a circular motion. 
This circular motion can then be transformed into the alternating linear movement of a piston or, if the turbine drives 
a generator, into an alternating electrical current. Turbines are self-oscillators, since they produce a periodic motion 
without a periodic input. 

The motion of a turbine is similar to a relaxation oscillation in that the amplitude is fixed but the frequency may 
vary depending on the speed of the flow and the friction on the turbine (the turbine's resonant frequency is zero, 
because there is no restoring force to move it back towards an equilibrium). However, unlike the relaxation oscillators 
described in Sec. IIVB1 the motion produced by a turbine is sinusoidal, because the wheel of the turbine is circular. 
The nonlinear switching is therefore gradual — being given the the circular turning — and does not occur suddenly at 
a threshold. 



B. Heat engines 

In practical steam engines, the feedback of the flow of steam on the turbine's motion is usually effected by a valve, 
which modulates the pressure of the steam in phase with the linear velocity of the piston atta ched to the turbine. The 
operation of such a steam engine is characterized mathematically as a self-oscillation in [l84| . Note that t he ac tion of 
the valve in such engines is not, strictly speaking, thermodynamical. For instance, the setup analyzed in |l84j would 
work equally well if the working substance were a fluid moved by a mechanical pump, instead of steam generated in 
a boiler. 

It is also possible to achieve the feedback necessary for self-oscillation by controlling the release of heat, rather 
than the mechanical motion of the working substance. This is the case of a Diesel engine, in which the compression 
of the working gas by the piston causes the fuel to ignite, injecting a large amount of heat into the gas. In an Otto 
engine (such as the one in a gasoline-powered automobile), the injection of heat into the working gas at the phase 
of maximum compression is trig gered by a spark-plug, whose action is timed accordingly. (On the Diesel and Otto 
thermodynamic cycles, see, e.g., jl85j .) 

There is also a class of "thermoacoustic self-oscillators," which we shall describe in detail in Sec. IVIIB1 in which a 
positive feedback is naturally established by the flow of heat between the working substance and its surroundings. A 
particularly fascinating and scientifically relevant instance of such a heat engine is seen in Cepheid variable stars (see 
Sec. lVllE4|) . 
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FIG. 23: Overshot water wheel. The power in the "tail" flow is an essential loss, making the efficiency of the wheel 
strictly less than 1. The illustration is by Daniel M. Short, available at |http : / /commons . wikimedia . org/ wiki/File : 
□vershot_water _wheel_schematic . svgj 



C. Limit efficiency 

Philippe Le Cor beille r 44 labeled self-oscillators as "motors," and passive devices (including forced resonators) as 
"transformers" [9(1 Il87l |. Le Corbeiller also noted that the efficiency of a "transformer" (i.e., the ratio of the power 
received to the power used to drive the output) can be taken to unity — if nonessential losses are eliminated — because 
the power is delivered at the same frequency with which the output moves. But when the power is inputed at a 
frequency different from that of the movement of the output, there is an essential loss of power that cannot be 
eliminated. This is the case for "motors" in general, for which the input is steady and the output periodic. 

In the van der Pol circuit of Fig. [101 the current that passes through the tunnel diode oscillates about lo , while the 
voltage drop across the diode oscillates about Vq. Thus there is an average power loss 

(Pdiodo) > Volo > , (66) 

in addition to any power dissipated in the resistance R. This essential loss (-Pdiodc) cannot be eliminated: no device 
can have a characteristic I-V curve with negative slope at the origin (VqIq = 0), since it would require the electrons 
to move against the electric field. 

The same principle is illustrated by the operation of the simplest turbine: the overshot water wheel, shown in 
Fig. [23] The water flow provides kinetic and gravitational potential energy, which are converted into the wheel's 
rotation. But some of the gravitational potential energy must be wasted, even if the wheel turned without friction, 
because water begins to spill out of the buckets before they reach the bottom. This "tail" flow is an essential power 
loss. That loss vanishes only in the limit of infinite wheel radius, in which case the motion ceases to be periodic. In 
an undershot wheel, the paddles must move out of the flow as the wheel turns, and the maximum effiency is therefore 
also strictly less than unity for a wheel of finite radius. 

Notice that the fact that water spills out of the buckets of the wheel before they reach the bottom also accounts for 
the modulation of the force of the water in phase with the horizontal velocity of the buckets: the force is large when 



Philippe Emmanuel Le Corbeiller (1891-1980), was a French- American electrical engineer, mathematician, and physicist, whose intel- 
lectual interests were remarkably broad. He was educated at the Ecole Polytechnique, worked on telegraph and radio systems, and 
earned a doctorate in mathematics from the Sorbonne. Le Corb eiller emigrated to the United States during World War II and became 
a professor of applied physics and general education at Harvard [186(1 . 
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the buckets are moving leftwards and downwards, smaller when the buckets are moving rightwards or upwards. Thus, 
the loss of power in the tail is necessary to set up the negative damping that causes the wheel to self -osci llate. 45 

Modern designs attain about 85% and 75% efficiencies for over- and undershot wheels, respectively [l89j . The most 
common type of hydraulic turbine used today for industrial applications is the radial inflow (or "center- vent" ) turbine 
developed by James B. Franc is in 1848, which spins on a horizontal plane and in which the tail flow leaves though the 
center of the wheel (see, e.g., |l90l |). The energy of this tail flow cannot be reduced beyond a certain limit, because the 
water must drain out at the same rate at which it enters the turbine. If gravity cannot cause the water at the center 
of the turbine to drain quickly enough, it will be pushed out by the flow, which implies a waste of kinetic energy. 

Another hydraulic instance of this same general principle is seen in a cistern placed under a steady stream of water 
and connected to a siphon so that the water level in the cistern performs a relaxation oscillation. 46 It is easy to show 
that the maximum efficiency goes to unity only when the frequency of that oscillation vanishes [l39j | . 

In an electrical motor, an essential power loss is caused by the "slip" (i.e., the relative motion of the rotor with 
respect to the magnetic field), which induces an electromotive force (the "back emf") that opposes the input voltage. 
This slip can vanish only when the input voltage has the same frequency as the motion of the rotor. Similarly, the 
self-oscillation ("nutation") of a spinning top, as described in Sec. IV A2\ must be accompanied by a steady precession, 
which also consumes energy if the tilt of the top's axis is varying. 

Le Corbeiller suggested in [l87| that Carnot's thermodynamic limit 

V < 1 - ^ (67) 

for the efficiency 77 of a heat engine that absorbs heat from a reservoir at temperature 7\ and releases heat into 
a reservoir at a lower temperature T2, might be an instance of this more general principle. Note that there is no 
fundamental obstruction to transforming heat completely into non-periodic motion (e.g., by having an expanding gas 
push out a piston, or by boiling water to generate a steady flow of steam) . What the second law of thermodynamics 
forbids is turning the steady heat of a reservoir entirely into the mechanical power that drives a periodic motion (see 
0,1). 

Non-unit efficiency does not, of course, imply irreversibility: e.g., a reversible Carnot engine operating between 
reservoirs with finite temperatures Ti^ has efficiency 77 < 1. But the fact that, in practice, self-oscillators robustly 
attain a unique limit cycle regardless of initial conditions and of previous transient perturbations does make them 
irreversible. This irreversibility results from the generation of entropy by the dissipation associated to the nonlincarity 
that determines the limiting cycle. Since all man-made clocks are nonlinear self-oscillators with a limiting cycle, this 
implies that they are themselves entropy generators. 47 



1. Carnot's theorem revisited 

It was Sadi Carnot's uniquely brilliant contribution in [l93j to show that no heat engine — operating between two 
heat reservoirs each with a constant temperature can have greater efficiency than a reversible engine (which may 
be theoretically implemented as a cycle of isothermal and adiabatic changes to the volume of an ideal gas, thus 
allowing us to compute that limiting efficiency in terms of the reservoir temperatures), assuming that the laws of 
physics forbid any process that merely converts heat from a source at a single temperature into the mechanical energy 
of a periodic motion. This axiomatic approach, later formalized by Clausius and Kelvin, was necessitated at the 
time by the ignorance of the nature of heat (i.e., by the lack of a microphysical understanding of thermal processes). 
Carnot himself stressed that mechanical engines (such as water wheels) may be completely described by the rules of 



In [l88t | . M. Denny proposes an overshot water wheel in which the buckets are attached by pivots to the rim of the wheel. Each bucket 
is tipped over and emptied at the bottom of the cycle, eliminating the tail flow. But this design cannot eliminate the power loss, even in 
principle, because the tipping of a bucket necessarily consumes energy. Even if each bucket were filled up to the maximum stable level, 
at which its center of mass coincides with the pivot, the center of mass descends relative to the pivot as the bucket starts to empty. 
It therefore would take finite energy to complete the emptying of each bucket, even if all friction and other forms of dissipation were 
eliminated. 

This setup was used by Le Corbeiller [9rl and Herrenden-Harker I139H as a pedagogical model of relaxation oscillation in general; see 
also |191| . It is the same mechanism by which a toilet flushes: the water level rises until it reaches the same height as the elbow of the 
siphon tube, thereupon causing the cistern to "fl ush" until the water level falls below the siphon's intake. 

Schrodinger makes a similar observation in |l92j| . where he explains that "if we remember that without a spring the clock is gradually 
slowed down by friction, we find that [its continued operation] can only be understood as a statistical phenomenon." 
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Newtonian mechanics, without further assumptions. 48 

Le Corbeiller's conjecture about the efficiency of frequency conversion is easy to show for mechanical systems, in 
which the input power can be expressed as 

Pin = F in ■ V in , (68) 

where Fj n is an instantaneous force and Vi n the velocity of the flow that provides the power. The power delivered to 
the output is 

Pout = q • F out , (69) 
where q is the time-dependent coordinate vector that characterizes the output. By energy conservation, at any instant 

Pout < Pin • (70) 

We may therefore normalize Vj n so that 

|Fout| < |F in | , (71) 

with the equality holding only when all of the flow is applied to the output q. Then we see that unit efficiency 
(Pi„ = Pout) is possible only when Vi n moves in phase with q, which can only be maintained during a complete cycle 
if the frequency of q matches the frequency of the input. 

In particular, if the input and output frequencies do not match, there must be a slip phase during which the output 
q moves against the input or away from it, so that P ou t < 0. During this slip phase, P ou t is non-negative only if the 
flow is completely diverted away from the output (i.e., if F out = 0). 

If the input and output waveforms have the same form (whether sinusoidal or otherwise), but different periods 
Ti < T2, then the efficiency 77 is limited by 

V<~- (72) 

T2 

This can be shown by imagining that the input and output oscillations start in phase at the origin, then letting them 
run for a sufficient number of cycles until they cross the origin in phase again (or infinitesimally close, if ti/t^ is 
irrational) . The difference in the number of input and output cycles can then be equated with the loss of energy from 
slip. Equation (|72l) is familiar from the limi ting efficiency of an AC motor in terms of the respective periods of the 
input voltage and of the rotor's motion (see [187j ). 

When the shapes of the input and output waveform are different (as they must be if the input is non-periodic) the 
efficiency limit is more difficult to express in generality, but it must still be strictly less than unity if the frequencies 
are not matched. For instance, in the case of the stick-slip motion of a violin string, illustrated in Fig. |6j during the 
stick phase AB the violin string moves with the bow {q — v- m ), so that P out = p n (if non-essential power losses are 
eliminated). But in order to describe a motion with a finite period, the string must eventually slip against the bow, 
giving P out < 0. 

Let v s be the speed of the violin string as it crosses the origin during the slip phase (at point C in the plot of Fig. [5]). 
Since the corresponding kinetic energy cannot exceed the potential energy at the maximum displacement (indicated 
by B in the plot), for an elastic string 

v 2 s < loIA 2 , (73) 

where ujq is the string's resonant frequency and A is the amplitude of the displacement. The time t s during which the 
string slips is therefore bounded as: 

t s > — > - ■ (74) 

V s W 



Some authors claim that Carnot's work on the effic iency of heat engines was inspired by an analogy between the flow that drives a water 
wheel — which his father had i nvestigated in [1941 — and the flow of heat in a steam engine. There is, however, very little evidence of 
this in his published essay 193]. Except for some obscurities associated with the fact that the nature of heat was then totally unknown, 
Carnot's argument is the same as that given by modern conceptual expositions of the second law of thermodynamics, such as 0] and Q. 
According to Kelvin, "nothing in the who le range of Natural Philosophy is more remarkable than [Carnot's] establishment of general 
laws by such a process of reasoning." Il95f 
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FIG. 24: Schematic representation of the operation of a motor, which takes a power input Pi n , with frequency Ui, and outputs 
a power Pout at frequency u)2- For many motors, including clocks, ui = 0. The "tail" represents the loss of power in the 
conversion of the two frequencies. 



Since the maximum efficiency during the stick phase (AB in the plot) is 1, and the maximum efficiency during the 
slip phase (BD in the plot) is 0, the total efficiency for the elastic string is limited by 

r ? < 27r ~^ =l--^0.68. (75) 

Even for an inelastic string, the limit t s —¥ requires that the energy of the string (and therefore also its amplitude) 
diverge, which is impossible with finite power input, except in the limit in which the period of the string's motion 
also diverges. 

Quite in general, we see that the energy wasted during the slip cannot be taken to zero in any system, even 
under ideal operating conditions, except in a limit in which frequency conversion fails. In the familiar case of the 
thermodynamic Carnot cycle, the slip appears as the phase of isothermal compression of the gas, during which heat 
is released into the colder reservoir at temperature T2. 

This result can then be used to show, by a straightforward generalization of Carnot's argument, that a motor that 
takes power at frequency uj± and outputs it at another frequency W2 cannot have greater efficiency than a reversible 
motor capable of the same conversion; otherwise the more efficient device could drive the other in reverse, making a 
composite engine capable of slipless frequency conversion. 

Thus, we may formalize a Carnot-Le Corbeiller theorem for the efficiency of motors: 

The efficiency of any motor converting a power input with frequency w\ to an output with frequency 0J2 
can approach unity only in the limit U2 — > u)\. The maximal efficiency of a motor that converts an input 
at uj\ to an output at LJ2 is that of the reversible operation of a given motor design. 

In Fig. [24] this is schematically represented by the loss of power in the "tail" (which we have named by analogy to 
the tail flow in Fig. [231). 

Note that there is no fundamental obstruction to converting the mechanical power in the tail completely and 
reversibly from one form to another (e.g., from a flow of water to the motion of buckets), as long as the frequency wi 
is unchanged. The power in the tail can also be irreversibly converted into heat by friction. 

Note as well that the wi 2 in the Carnot-Le Corbeiller theorem are not analogous to the T\$ in Eq. (I57|) . For heat 
engines, u>x = and UJ2 > is arbitrary. Furthermore, in phenomenological thermodynamics temperature is defined 
in terms of the limit efficiency, as given by the reversible Carnot cycle (see 0,Q). 
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Recall that the second law of thermodynamics (in Kelvin's formulation) forbids a machine to return to an initial 
configuration (described by a coordinate vector q^ - 1 ) after merely having transformed a certain amount of heat into 
mechanical work. Similarly, it is clear from the Carnot-Le Corbeiller theorem that no motor can return to its initial 
configuration, having merely absorbed power at a frequency different from that of its own motion. For example, the 
"overbalanced" wheel in Fig. [1] fails because gravity is steady and therefore pulls down with the same force when the 
weights are moving down as when they are moving up, so that integrating over one period r of the motion of any 
given weight gives 

W net = / dt F • q = -mg f dty = mg [y(0) - y(r)] = , (76) 
Jo Jo 

where y(t) is the vertical coordinate for the weight and mg is the magnitude of the downward force exerted by gravity. 
The water wheel in Fig. [23] must waste some of the power of the water because it must be diverted into a tail flow to 
prevent it from acting on the buckets when they are moving in a direction contrary to that of the flow (i.e., either to 
the right or upward in the illustration). 

Parametric resonance, discussed in Sec. IIII F| would seem to offer a counterexample to the Carnot-Le Corbeiller 
theorem, since small angular oscillations can be driven with unit efficiency when the driving frequency is twice the 
frequency of angular motion. Note, however, that it is actually the frequency of the vertical displacement y (which is 
twice the frequency of the angular motion 9) that should be interpreted as w 2 when applying the Carnot-Le Corbeiller 
theorem to the parametrically driven pendulum of Fig. [5] In other words, the lossless conversion of frequencies is 
purely geometrical, not dynamical: even in a free pendulum, the frequency of y{t) is twice the frequency of 9(t). 

We do not know whether, by working in a multidimensional space, such a geometrical frequency conversion can 
give a ratio other than 2. Such conversion cannot, in any case, be applied to devices in which oj\ — (such as heat 
engines and most other motors) or to any device in which u>i /0J2 can vary continuously. 



2. Minimal friction in mechanisms 

An instructive application of the Carnot-Le Corbeiller theorem is to the action of gears. 49 An angular velocity ui\ 
can be converted to different angular velocity w 2 by using gears of radii 7*1,2 so that 

win = w 2 r 2 , (77) 

but this process cannot approach unit efficiency. 

Consider a given tooth on the powered gear (the "driver"), which comes in contact with a tooth on the other gear 
(the "follower"), as shown in Fig. [25] If the driver tooth is powered by a tangential force Fi n , then 

Pin = F in • v in = F in uj iri . (78) 

For uji to be constant, Fi n must be exactly cancelled by the reaction — F out from its pushing on the follower tooth. 
Let Vj n and v out be, respectively, the instantaneous velocities of the driver tooth and the follower tooth, which by 
Eq. ([77]) are of equal magnitude. In the steady state the power delivered to the follower tooth is therefore 

Pout = F out • v out = F in wiri cos 6» < P in , (79) 

where 9 is the angle between v; n and v out . Thus, some power must be lost unless the motions of the teeth are aligned 
(9 = 0), which occurs only at the configuration of Fig. [25l b). When the teeth are engaging, as in Fig. l25f a). or 
disengaging, as in Fig. 12'51' c'). they are moving relative to each other along the direction of a line that joins the centers 
of the two wheels, and the teeth are therefore slipping. 

In practice, the difference p n — P ou t goes into heating the gears by the friction associated with the slipping of the 
teeth against each other, or with the turning of the follower's axle. If there were no friction at all, so that P ou t = Pn, 
then for 9 ^ we would have either F out > F ln or ^2^2 > so that slipping would make the follower gear speed 

up relative to the driver, causing the teeth to become misaligned and finally crush each other. 

Note that there must be a loss from slippage even for 7*1 — r2, in which case the gears turn with the same angular 
velocity uj\, but in opposite directions. The power loss can only be eliminated in the limit 7-1,2 — > 00, in which case 
the teeth can be permanently engaged and there is no frequency conversion. 



I thank Charlie Bennett and Graeme Smith for calling my attention to this problem. 
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FIG. 25: At (a), a tooth on the driver gear (below) has begun to engage a tooth on the follower gear (above). At (b), the 
two teeth are fully engaged and there is no slippage between them. At (c), the teeth have begun to disengage. The lab el Vj n 
indicates the instantaneous velocity of the driver tooth, and v out that of the follower tooth. Image adapted from Fig. 8 in |196| ] . 



More intuitively, the point is that as the teeth in the driver disengage and move away from the follower, they carry 
kinetic energy that was not delivered to the follower. This is analogous to the "tail flow" away from the water wheel, 
shown in Fig. [331 Unlike in the case of the water wheel's tail flow, the teeth of the driver come back around and 
re-engage with the follower. But for the overall process to be lossless, the kinetic energy in the driver's teeth just after 
disengagement (the "tail") must be steadily decreasing relative to the kinetic energy of the follower, which implies 
that the driver must be decelerating relative to the follower. Not only would this mean that wi,2 in Eq. ([77)) would 
not be constant, it could not be sustained because the gear teeth would become misaligned. 

The claim that gears can operate frictionlessly if designed so that the point of contact of the teeth remains collinear 
with the centers of the two wheels — thus eliminating the slipping of the teeth against each other — dates back to 
Robert Hooke, who refe rred to it as "the perfection of Wheel- work; an invention which I made and produced before the 



Royal Society in 1666" |197| . Airy [1981 ] and others argued tha t thi s was possible if the teeth were cut as logarithmic 



spirals. This was extended to a broad class of curves by Willis [199]. In such designs, however, the ratio ri/r-z, which 
gives the mechanical advantage of the action of the driver on the follower, increases while a given pair of teeth is 
engaged, which in the absence of friction would imply that the follower would accelerate relative to the driver. 

That steady gear action is impossible wi thou t finite friction was demonstrated, using geometrical techniques, in 
Willard Gibbs's 1863 doctoral dissertation [200j j . ten years before he turned his attention to thermodynamics. Re- 
markably, we have found no indication that Gibbs's result has ever been appreciated. 50 

If, instead of gears, we consider two smooth wheels rolling against each other without slipping, the reason why 
the driving of one by the other cannot be lossless is even clearer: For one wheel to turn the other, there must be a 
sufficient attraction between the material in the rims. Therefore, it costs finite energy to unstick the rims after their 
point of contact. It is not possible to get rid of that loss from unsticking without also eliminating the coupling that 
allows one wheel to turn the other. 

A similar analysis can be made for gears connected to chains, or for shafts wrapped by belts. In the case of chains, 
there must be some loss as the links engage and disengage from the teeth in the gearing. Similarly, it must consume 
non-zero energy to unstick a belt from the surface of the shaft. Note that if one wheel turns another via a chain or a 
belt, there is a lossy conversion of power to and from zero frequency (the linear motion of the chain or belt), even if 
both wheels have the same radius and turn at the same rate. 

In general, mechanisms can only convert the finite difference between input and output power (the "tail" of Fig. [24]) 
into frictional heat. Thus we see that their operation is necessarily irreversible. 

To quantify the limiting efficiency of the action of smooth wheels or belts, let A be the linear density of the mass 
along the rims and ds be the infinitesimal length of the region of contact between the rims, as shown in Fig. [551 
"Rim" is here defined as the finite-width annulus of solid material along the exterior of the wheel or belt that is in 
effective contact with the other device, and which is therefore involved in the interaction that causes static friction at 
the point of contact. 



Gibbs's thesis refers specifically to "spur gearing" in the title, but its results extend as well to what are now called helical gears. This brief 
and highly ab strac t dissertation remained unpublished until 1947, when it appeared with a commentary by Yale engineering professor 
E. O. Waters [20 ll that shows no interest in Gibbs's demonstration of the impossibility of frictionless gearing. It is true that this is 
more a question of geometry and theoretical physics than of practical engineering, because the action of the gear teeth is not usually 
the principal source of dissipation in real-world mechanisms, which are therefore far from their limit efficiency. 




FIG. 26: The lower wheel (the driver) turns the upper one (the follower) by rolling without slipping at the point of contact, 
where the mass elements on the rim have a common velocity v. Each element has mass A ds, where A is the linear density of 
the rims and ds is the tangential length of the region of contact. The thickness of the rims is determined by the depth of the 
layer of solid material involved in producing static friction at the point of contact. 



For the driver to be able to move the follower at speed v without slipping, a mass element Xds on the driver's rim 
must be able to come in from infinity with speed v, "collide" at the point of contact with the corresponding mass 
element — initially at rest — on the follower, and then have the two elements move together with speed v. 51 Thus, by 
energy conservation: 

^{\ds)v 2 = (\ds)v 2 - dE , (80) 

where — dE is the potential energy corresponding to the attraction of the rim elements when in close proximity. It 
must therefore cost energy dE to unstick the rim elements past their point of contact. If at least one of the wheels 
has finite radius, this unsticking occurs over an infinitesimal time 

dt= — . (81) 

v 

By Eq. (|80l) . the minimum power consumed by the rolling friction is therefore 

dE _ \v 3 

P in _ Pout ____ . (82) 

This cannot be taken to zero for v > 0, since A must be finite, as otherwise there can be no action between the devices 
(just as gears cannot operate with massless teeth). The point is that, even in a conservative system, the energy 
involved in the unsticking of the rims cannot be transferred from the driver to the follower, because they are moving 
apart. 

When the wheels are turning steadily, the force that powers the rim of the driving wheel is cancelled by the static 
friction / from the contact with the follower wheel. Thus, the input at the rim of the driving wheel is: 



so that the efficiency is constrained by 



Pin = fv (83) 



*=^<l-jf-, (84) 



where / max is the maximal static friction for the materials on the rims. Clearly, / max depends on A, since 

lim / max = ; lim A = oo . (85) 

A^O /max— >OC 



Of course, the rim of the follower is not at rest when the wheels are turning steadily. But this procedure allows us to calculate the 
condition such that all the energy of the follower comes entirely from the driver. 
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What the precise behavior of A// max might be lies beyond our personal knowledge of tribology, but Eq. (|84| suffices 
to establish that the efficiency of power transfer between wheels turning without slipping (or between a shaft and a 
belt) cannot be taken to zero, as required by the Carnot-Le Corbeiller theorem. 



VII. OTHER APPLICATIONS 



A. Servomechanisms 



It is very common in engineering for a system to be driven by a self-oscillating motor, which in turn is controlled 
by negative feedback so that the motion follows some intended trajectory. This is called a servomechanism, and the 
simplest example is a steam engine whose rate is fixed by the action of a governor, as we mentioned in Sec. IV A 11 

The onset of an unwanted self-oscillation about the servomechanism's intended trajectory is sometimes called 
"hunting" in mechanical systems, and "parasitic oscillation" in electronics. The presence of such oscillations can be 
diagnosed by applying the Routh-Hurwitz criterion to the linearized equation of motion for small perturbations about 
the intended trajectory. But for servomechanisms i n pa rticular it is usually more practical to use the stability criterion 
in a different form, proposed by Harry Nyquist in [202j j and based on the form of the gain as a function of frequency. 
Th e Ny quist stability criterion, which is central to modern cont rol theory, is reviewed from a physical point of view 



in [159j . For a more thorough mathematical treatment, see [203] . 

An important type of "hunting" is the swaying of a railway vehicle when it travels a bove a critical speed [204l l205j | . 
Parasitic oscillations are a common problem in electronic amplifiers, as discussed in [206l j . "Intention tremor" is a 
neurological disorder seen in patients with injuries to the cerebellum, such that if the patient, for example, tries to pick 
up a pencil, his h and will overshoot the position of the pencil and then go into an uncontrollable oscillation around 
it (see, e.g., [207| V Mathematician Norbert Wiener characterized vo lunta ry human motion as a servomechanism and 
pointed to intention tremor as a parasitic oscillation of that system [208j ] . 



B. Thermoacoustic self-oscillators 



A thermoacoustic self-oscillator is a device in which the flow of heat between the working substance and its surround- 
ings sustains an oscillation of that working substance's volume and pressure. The resulting vibration can produce a 
sound of a well-defined frequency that propagates through a surrounding medium, though of course the generation of 
sound is incidental and for the most part we will only be interested in the oscillation of the working substance itself. 
A thermoacoustic self-oscillator differs from an ordinary heat engine in that a positive feedback is established without 
any mechanical valve (or other device) controlling the motion of the working substance (see Sec. I VI Bj) . 



1. Putt-putt boat 



An amusing and instructive instance of thermoacoustic self-oscillation is the putt-putt (or pop-pop) boat, a toy 
whose circula tion dates back at least to the early 20th century, when it was being fabricated by Nuremberg toymaker 
Ernst Plank [209(. The design had been patent ed in 1891 by Desire Thomas Piot, who described it as a "steam 
generator" well suited to "the case of toy boats" [210j . The putt-putt was once very popular but is no longer easily 
bought, partly because it must be made of metal, while most toys today are plastic. 52 

The putt-putt works by heating (usually with a flame) an internal tank partly filled with water and connected to 
submerged exhausts, as shown in Fig. [27] It is usually easy to adjust the heat so that the water level will self-oscillatc. 
As water is alternately blown out and sucked in through the exhausts, the boat moves forward with a noisy vibration 
that gives the toy its name. 53 



Iain Finnie relates how, after becoming a professor of mechanical engineering at UC Berkeley in 1961, he began conducting popular 
lectures o n the operation of various toys, at which the putt-putt (a favorite toy from his own childhood) always at tract ed the most 
attention l21lll . The putt-putt featured prominently in the animated Japanese feature film Ponyo, released in 2008 I212H . Toy boats 
were sold as tie-ins when that movie came out. 

There has been a remarkably enduring confusion in both the research and the popular literature about why the boat does not move 
backwards when w ater is dr awn into the exhausts, a confusion dating to the first published scientific discussion of the putt-putt boat 
by J. G. Baker in [162| . |213| . The correct explanation is very straightforward: water flowing out of the boat carries momentum away 
with it. By Newton's third law, the boat must pick up an opposite momentum, propelling it forward. When water is aspirated, there's 
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FIG. 27: Schematic of the putt-putt boat: y measures the displacement of the liquid level away from equilibrium, A is the 
cross-section of the tank, and h the distance between the top of the tank and the level y — 0, so that the volume of gas in 
equilibrium within the tank is Vo = hA. 



According to the law of ideal gases, for a small displacement y of the liquid level away from its equilibrium, the 
pressure of the gas inside the tank, at a fixed temperature, is 

C N 

P = T7 x~ - P o + k iV > (86) 

V - Ay 

where No is the quantity of gas inside the tank (measured in moles), while Po = CNq/Vq and k\ = CNqA/Vq are 
constants. The force A(Po — P) that acts to restore y to its equilibrium is therefore proportional to y. Thus, small 
oscillations behave like a damped harmonic oscillator 

y + ly + u 2 y = Q (87) 



(which is what Boyle memorably called the "spring of the air" [217]). 

Through the heating of the tank, the pressure inside acquires a dependence on S, the quantity of steam: 

V - Ay 

As explained in |218ll219j . S increases by a constant evaporation rate and decreases by a condensation rate proportional 
to the surface area inside the tank that is not covered by liquid. In equilibrium (which we define as y = 0) the 
condensation rate balances the evaporation rate, 54 so that 

S = h ■ y . (89) 

Thus there is a back-reaction of the oscillation of the water level y on the pressure difference Po — P that drives it. 
This back-reaction is such that a positive feedback, and therefore a self-oscillation, can be established, as we will see. 55 
By Eqs. I89")) . the equation of motion for small oscillation of y is 

y + 72) + oj 2 y = -C 2 P Q [ df y , (90) 



where C 2 is proportional to the value of k 2 in Eq. For sinusoidal motion, the term on the right-hand side of 

Eq. (|M| will be in phase with y and therefore can feed energy from the candle into the self-oscillation of y, whose 



initially a reaction on the boat that would pull it backwards, but the incoming water soon impinges on the inner walls of the tubes and 
imparts its forward momentum to the boat. The initial backwards reaction on the boat is therefore cancelled by the forward pushing of 
the water on the boat's insides. This is discussed in detail in 121411 . In the French engineering literature, the fact that a tank will recoil 
if water pours out of it but not i f water pours steadily into the tank is sometimes called the "paradox of Bergeron," after mechanical 
engineer Paul Bergeron |215t |216| . 

54 If there is no such equilibrium, the water will be pushed out completely and the putt-putt boat will not run. 

55 The schematic in Fig. l27l and the treatment in terms of the level y are somewhat idealized. Experimentally, it seems that the liquid leaves 
the tank comple tely during the high-pressure phase and that the steam only begins to condense when it reaches the tubes that connect 
to the exhausts 2201 . This is because the walls of the tank are too near the flame and therefore too hot for effective condensation. 
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FIG. 28: A Rijke tube is open on both ends and has a heated metal mesh near the bottom. The movement of the air through 
the pipe is a combination of a steady upward convection flow and an oscillation given by the periodic variation of the pressure 
inside the tube. This acoustic oscillation will produce a loud tone as long as the mesh stays hot. 



amplitude increases until nonlinear effects stabilize it [219(. 56 Evidently, the criterion for self-oscillation is 

C 2 Po > w 2 7 , (91) 

in which case the term on the right-hand side of Eq. (|90p overwhelms the second term of the left-hand side, effectively 
giving y a negative damping. 

The putt-putt, like any other heat engine, must absorb heat from a region with temperature T\ (the evaporating 
water warmed by the candle) and reject a lesser amount of heat into a region with lower temperature Ti (the tank walls 
on which the steam condenses), with the difference available as work to move the liquid. Since steam is generated and 
re-condensed in the same chamber and therefore at nearly the same temperature, Eq. (|67p implies that the maximum 
thermodynamic efficiency of the putt-putt is very low. On top of that, Finnie and Curl found that in the toys they 
examined only about a tenth of the work on the water was con verted int o propulsion of the boat, the rest being 
dissipated by the damping of the motion of the liquid in the tubes |218l l219j . Nonetheless, the putt-p utt 's mechanism 
is interesting as an instance of a valveless pulse jet engine. Furthermore, Finnie and Curl point out in [218j | that if the 
tank were substituted by a large bellows, driven up and down by the oscillation of the i nternal pressure, the result 
would be a valveless version of the first steam engine patented by Watt in 1769 (see |22l| ). 



2. Rijke tube 

An even simpler (and perhaps more striking) demonstration of a thermally-driven self-oscillation is the Rijke tube 
[222l | , shown schematically in Fig. [211 If a wire mesh is attached near the bottom of large tube that is open at both 
ends and if the mesh is heated with a flame until it glows red, then after the flame is withdrawn the tube will produce 
a very loud tone, like that of an organ pipe, which dies out when the mesh cools. The tone can be sustained at will 
by heating the mesh with an electrical current, rather than a flame. 



An important nonlinearity is the dissipative pressure loss of the liquid during inflow, described in detail in Sec. 5 of [214) . This adds to 
Eq. H90H a damping term proportio nal to (y + \y\) 2 ■ Since this acts only during the inflow phase (y > 0), it can result in an asymmetric 
limiting cycle for y, as reported in [218l . |21S| . 

In one of the more popular putt-putt boat designs, the top of the tank is a flexible diaphragm that reverses its concavity during the 
cycle of the gas pressure. This is not essential to the operation of the devic e: it s primary function appears to be to reduce the value of 
ui so as to make it easier to fulfill the self-oscillation condition of Eq. I|91j l [219l |. The diaphragm also makes the oscillation noisier, an 
attractive feature in a child's toy. 
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The operation of the Rijke tube is explained in [223l |224| . Due to convection, there will be a constant upward flow 
of air through the tube. Meanwhile, an oscillation of the pressure within the tube causes a periodic airflow that is 
superimposed on the steady upward convection. That oscillation causes air to pass through the hot mesh in alternate 
directions. When the velocity of the oscillation is at its maximum, it adds to the steady convection and maximizes the 
amount of fresh air that is being heated as it passes up though the mesh. This air then exerts a further upward push. 
After half a period of the oscillation, air is pushed down through the mesh, but this air is already hot and therefore 
causes little upward pushing. Thus the pushing of the newly-heated air is modulated in phase with the velocity of 
the acoustic oscillation inside the tube, establishing positive feedback. 

It should now be clear that the tube can self-oscillate only if the hot mesh is in the bottom half of the tube, and also 
that the reason why the tube will not ring until the flame is removed is th at th e flame heats the air before it reaches 
the mesh. The Rijke tube is the simplest thermoacoustic self-oscillator; see [225| | for some recent investigations on the 
subject. It can provide a simple and impressive lecture demonstration of self-oscillation in general, since it should be 
obvious to students that the loud ringing is not being driven by any periodic forcing term external to the system. 



3. Rayleigh criterion 

The Rijke tube illustrates a general principle known in mechanical engineering as the Rayleigh criterion: 58 the 
acoustic oscillation of a gas is encouraged if heat is injected as the ga s is warm ed by adi abatic compression, and/or 
heat is removed as the gas is cooled by adiabatic expansion [226l l227j | (see also |224l . [228] ) . An acoustic oscillation is 
most encouraged if the transfer of heat out of the gas varies in phase with the volume, so that the maximum heat is 
injected when the the gas is most compressed and therefore hottest, while the maximum heat is removed when the 
gas is most rarefied and therefore coldest. 

This can also be understood by analogy to parametric resonance: when heat is injected, the "spring of the air" is 
stiffened, whereas when heat is removed the spring is slackened. If the stiffening aids the motion towards equilibrium 
and the slackening aids the motion away from equilibrium, then the overall oscillation is encouraged. But unlike in the 
parametrically resonant systems described in Sec. IIII F[ in self-oscillators the variation of the elasticity is controlled 
by the acoustic vibration itself. 

Ordinarily, sound waves are thermally damped because the air loses heat most quickly when its temperature is 
highest due to compression, while it ab sorb s the most heat when its temperature is lowest due to expansion. Newton 
famously computed a speed of sound |229l ] which turned out to be too low (by about 20%) in light of subsequent 
experimental tests. In effect, he treated the acoustic oscillation as isothermal. His expression is correct in the limit in 
which the frequency of sound is so low that the vibrating air re main s in thermal equilibrium with its surroundings. 
Laplace obtained a value more compatible with measurements [230j by approximating the oscillation as adiabatic, 
which is valid in the limit in which the oscillation is very fast compared to the rate of damping by thermal radiation. 59 

Note that the putt-putt boat (Sec. IVII B ip . unlike the Rijke tube, optimizes the Rayleigh criterion, since Eq. (|89|) 
implies that the heat removed by the condensation of steam varies in phase with the volume of the working gas 
inside the tank. Diesel and gasoline engines — though not usually conceptualized as thermoacoustic oscillators — also 
optimize the Rayleigh criterion, by igniting the fuel (and therefore maximizing the injection of heat) when the working 
gas is most compressed (see Sec. I VI Bj) . 

Another interesting thermoacoustic self-oscillator is the "singing flame:" if a small flame, produced by hydrogen 
burning as it leaves a narrow tube, is inserted into a larger tube — which may be either open or closed at the top — 
the air inside the larg er tube can in some circumstan ces r ing audibly in a sustained way. This phenomenon was 
first described i n I232H and is discussed by Rayleigh in [233| . though his treatment was later found to be somewhat 
incomplete (see dUnBl HI). 



4- Cepheid variables 



Cepheid variable stars are a very important instance of natural thermodynamic self-oscillation. Their name derives 
from John Goodricke's observation, in 1784, that the brightness of the star 5 Cephei varied regularly with a period 
of about five days. Goodricke and his colleague Edward Pigott then discovered other stars whose brightness also 



This is not to be confused with the better-known "Rayleigh criterion" in optics. 

On the relevance of Rayleigh's criterion to understanding the diffe rence between Newton's and Laplace's computation, see 226, 227]. 
On the historic controversy regarding the speed of sound, see [23111 . 
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FIG. 29: The waveform above represents the variation in the brightness of a typical Cepheid variable star, which increases 
rapidly and then fades gradually, with a period of a few days. The circles below schematically represent the corresponding 
variations in the size and color of the star, which have been exaggerated for clarity. The oscillation in brightness leads the 
oscillation in the volume of the star by a quarter of a period. This illustration is adapted from 243] . 



pulsates, usually with a period of a few days. In the early 20th century, Henriett a Sw an Leavitt discovered that the 
period of a Cepheid's pulsation is tightly related to the star's intrinsic brightness |236| . This made Cepheid variables 
the first reliable "standard candle" by which astronomers co uld m easur e dis tances to other galaxies, leading eventually 
to Edwin Hubble's discovery that the Universe is expanding |237t j . See |238l ] for a review of the history and the science 
of this subject. 

When a yellow supergiant star is running out of hydrogen fuel, it may begin to collapse. The compression causes an 
increase in temperature and pressure that slows down the collapse and eventually causes the star to expand and cool. 
The resulting cycle of the volume of the star would be damped away relatively quickly if it were not for a mechanism 
that injects heat into the core of the star during the compression phase and removes it during the expansion phase, 
in accordance with the Rayleigh criterion (see Sec. IVIIB 3ft . 

As the core is compressed, the rate of nuclear fusion increases (much like the fuel ignites during compression in a 
Diesel engine). The excess heat produced is not radiated away because the core of a Cepheid is surrounded by a layer 
of ionized helium (He + ) and the radiation from the heated core causes that layer of helium to become doubly ionized 
(He ++ ) , making it more opaque and preventing the heat from escaping. During the expansion, the helium layer cools 
and goes back to being singly ionized, which decreases the opacity and allows heat to escape. 

In 1916, Arthur Eddington became interested in the thermodynamics of stars when he realized that the pulsation 
of the Cepheids presented a theoretical puzzle, namely, 

to find if possible some cause maintaining the mechanical energy of pulsation against the loss by dissipative 
forces — some method by which the mechanical energy could be automatically extracted from the abundant 
supp lies of heat at different temperatures in the star without violating the second law of thermodynamics. 

Eddington's first paper on the subject [24Cf rediscovered the Rayleigh criterion and proposed applying it to the 
Cepheid problem. In his 1926 book, The internal constitu tion of the stars, he explained that "we must make the star 
more heat-tight when compressed than when expanded" 241], and he drew an analogy between the corresponding 
mechanism and the action of the valve in a heat engine. The realization that this heat- tight ening is due to the double 
ionization of a thin, outer helium layer was due, many years later, to S. A. Zhevakin [2421 ] . This mechanism is now 
called the "Eddington valve," which might be something of a misnomer, because the helium layer controls the flow of 
heat, rather than the mechanical motion of the stellar material (see Sec. IVI Bp . 

Figure shows a schematic plot for the brightness and the radius of a typical Cepheid variable, as functions 
of time. The brightness (which is directly related to the flow of heat out of the star's core) is in phase with the 
radial velocity of the star's surface (which gives the rate of the change of the star's volume). The oscillation of the 
brightness therefore leads the oscillation of the volume by a phase of tt/2, which is sub-optimal from the point of view 
the Rayleigh criterion, but adequate to maintain the pulsation. In this respect Cepheid variables are most akin to 
the Rijke tube, described in Sec. IVIIB 21 
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C. Lasers 



Masers and lasers may be described as electromagnetic cavities in which the dielectric loss (i.e., the damping) is 
negative because the molecules or atoms of the dielectric medium have undergone a population inversion: more of 
them are in a higher-energy quantum state than in a lower-energy state to which transition via photon emission 
is possible. The electromagnetic oscillation within the cavity therefore causes the dielectric medium to feed energy 
into the oscillation by stimulated emission: the medium is t herefore c alled "active." For introductory discussions of 
stimulated emission in two-state quantum systems, see, e.g., |244l . |245| . 

A laser is therefore an electromagnetic self-oscillator, even though the mechanism responsible for the negative 
damping is quantum-mechanical and — unlike in a classical self-oscillator — requires a precise tuning of the energy 
separation AE of the quantum states involved in the stimulated emission, so that the photons emitted have an a ngul ar 
frequency U) — AE/h (where h is the reduced Planck constant) that is very close to the cavity's resonance (see [246j ). 

On the other hand, the population inversion that sustains the negative damping is achieved without tuning the 
frequency of the external power supplied to the active medium. The ratio of the laser's power output (in the forms of 
photons of energy E = fkd) to the total power inpu t is therefore subject to limitations analogous to those discussed 
in Sec. IVI C II for classical self-oscillators. See [247l j for a basic discussion of the way in which population inversion 
is accomplished; essential power losses are seen in the production of photons or phonons with energies different from 

huj. 60 

Charles Townes, the inventor of the first maser, explained the principle of its operation to laypeople by a simple 
mechanical analogy: Imagine a swimming pool, at one end of which a platform has been raised on a wobbly pillar. 
The platform is loaded with rocks (by analogy to population inversion). When a rock falls into the water, it produces 
a wave that travels to the other end of the pool, is reflected, and then hits the wobbly pillar, causing another rock 
to fall. If the wobbling of the pillar absorbs negligible energy from the wave, this serves as an analogy of stimulated 
emission. The falling rock then produces a new wave, which interferes constructively with the previous one. The 
process can continue as long as there are r ocks on the platform, giving what Townes called a waser. water amplification 
by stimulated emission of rocks; see [248j . 

Townes 's analogy nicely captures the nature of the laser as a self-oscillator in which the negative damping comes as 
quanta of energy quanta. The only important element that the waser lacks is an analog of the tuning of the energy 
of the rocks to the frequency of standing waves in the pool, which is substituted in the waser by the need to time the 
fall of the rocks so as to produce a new wave precisely in phase with the previous reflected wave. (This feature of the 
analogy is inevitable, since in the classical limit h — > 0.) 

Borenstein and Lamb showed in d etail that a self-oscillating electromagnetic cavity may be built using only the 
laws of classical electrodynamics [2491 ] . They avoid the need to tune the phases of the oscillators in the active medium 
by making them nonlinear, so that they can be entrained (see Sees. IIVEI and IV B 3|) . On the (wholly academic) 
possibility of describing classical self-oscillators as quantum lasers, see [250(. 

The ap plications of the concept of self-oscillation to the semi-classical theory of lasers are treated in detail in 
[l05l l25l| . including the relaxation os cillation s een in ruby lasers. The relevance of entrain ment to the description of 
the operation of lasers is discussed in [25214254 1. On chaotic behavior in laser systems, see |255l j. 

An important and instructive kind of macroscopic quantum oscillation is the alternating Josephson curr ent b etween 
two superconductors separated by a thin insulator and held at a constant voltage difference by a battery [256j | . Since 
this is conceptually quite distinct from the operation of a laser, and since its description requires a longer excursion 
into quantum mechanics, we treat it separately in Appendix |A"1 



D. Business cycle 



Pippard mentions geysers and the egg-laying cycle of domestic fowl as naturally-ocurring relaxation oscillations |257j . 
Sargent, Scully, and Lamb 105] mention also the business cycle in macroeconomics, i.e., the familiar fluctuation of 
production and economic activity that has often led to periods of rapid growth followed by recessions. 



In quantum physics, the origin of the Carnot-Le Corbeiller efficiency limit is very clear, perhaps even clearer than in the classical case. 
The probability of photon absorption by the medium goes to 1 only when the frequency of the photon approaches AE/h for a transition. 
In practice, the population inversion mechanism involves a variety of transitions, only one of which corresponds to the frequency of the 
laser light outputted. The other transitions generate photons and phonons which bounce around the cavity and eventually exit it or 
else thermalize, heating the dielectric medium. 
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In fact, interest in modeling the business cycle as a relaxation oscillation was sparked in the 1930s, largely through 
the influence of Le Corbeiller, who explained to economists that 

if statistical observation leads us to believe that a given magnitude varies periodically, and if we look for 
the cause of those oscillations, we may suppose that that magnitude executes either (a) forced oscillations, 
or (b) self-oscillations, 61 which may be either (bet) sinusoidal or (b/3) of relaxation type. [258| 

Lc Corbeiller also had a great direct influence on the work of Harvard economist Richard M. Good win [259| | , 62 
Goodwin's self-oscillatory m odel of the busines s cyc le is similar to those proposed by Michal Kalecki |260j | , Alvin 
Hans en and Paul Samuelson |26l| . Lord Kaldor [262j |. Sir John Hicks j263| . and others (see |264| ). Chang and Smyth 
[265j and Varian |266| reformulated Kaldor's nonlinear model so that the business cycle corresponds to a relaxation 
limit cycle on the Lienard plane, like that represented in Fig.[TSl with the c oordinates x and y interpreted as the total 
income and the capital stock, respectively. This is briefly reviewed in [267j |; for a complete treatment, see [268| . 




These theories relied on Keynesian macroeconomic constructs — the IS/LM and "multiplier-accelerator" models — 
which fell out of favor in the late 20th century because they lack adequate microeconomic foundations (i.e., an 
explanation in terms of the choices made by in divid uals) and therefore came to be seen as insufficiently explanatory 
and as being vulnerable to the "Lu cas critique" [269j | that if individuals incorporated the cycle into their expectations 
then it should disappear. In [265| . Chang and Smyth also emphasize that self-oscillation in Kaldor's model occurs 
only for certain choices of the macroeconomic parameters. 

That the business cycle may be due, at least in part, to a relaxation oscillation seems plausible in light of John 
Geanakoplos's recent work on the theory of the financial "leverage cycle" [270j . In Geanakoplos's theory, the leverage 
(i.e., the ratio of the value of an asset bought on credit to the down-payment by the buyer) is not necessarily 
stabilized by the equilibrium of supply and demand, and may therefore be subject to positive feedback effects that 
lead to relaxation- type oscillations in asset prices, which i n turn c an drive the economy as a whole into recurring 
booms and busts (for commentary on this theory see, e.g., [27ll4274j |). 

This leverage cycle might provide the microeconomic foundation that has been missing from models of th e bu siness 
cycle as a self-oscillation. See also, e.g., the work by Minksy on the "financial instability hypothesis"_J275j , and 
by Gjerstad and Smith on the role of credit expansion and leverage in the late 2000's financial crisis [276j . What 
principally seems to be lacking at the moment from the theory o f the lever age cycle is a solid understanding of just 
how financial markets evade the Arrow-Debreu welfare theorems [2771 |278| , thus failing to give consistently efficient 
outcomes. 

It should be stressed that the attempt to use control theory and the theory of dynamical systems in economics has 
a very long history, but has so far yielded few fr uitfu l results. Astrom and Murray suggest that this is in part because 
in economics "there are no conservation laws" |279l |. This hardly seems to us a satisfactory explanation, since none 
of the other systems treated in this article obey conservation laws either. It is also commonly argued that economic 
systems are too complex and have too many variables, but this seems equally true of biological systems, in which 
the theory of dynamical systems has been used more profitably (see Sees. ITVDl ITVEl and IVB4I) . Sometimes it is 
also pointed out that controlled experiments are not possible in macroeconomics, but the mathematical theory of 
dynamical systems largely grew out of research in another science without controlled laboratory experiments, namely 
astronomy. 

It seems to us, rather, that the principal complication is that the economic order results from the actions of sentient 
individuals, whose response depends on the information available to them at any given time. This information is 
constantly changing and includes even some awareness of economic theory itself and its predictions. 

The Arrow-Debreu theorems establish that under conditions of perfect information and complete markets, the 
economic system will always be at an equilibrium state in which every individual enjoys the greatest satisfaction that 
can be obtained without making another individual worse off (what economists call an "efficient" outcome). But most 
of the interesting, real-world economic phenomena probably take place away from that equilibrium 63 and, in practice, 
the approach to equilibrium occurs under conditions in which information is far from perfect an d markets are far from 
complete. From this economists have drawn strikingly divergent conclusions about policy (cf. [28Ct l28l| ). 



61 Le Corbeiller writes oscillations autoentretenues, which would be more faithfully rendered in English as "self-maintained oscillations." 
On the many names of self-oscillation, see the first footnote in Sec. U 

62 Le Corbeiller, for his part, credits Goodwin with the original insight that two-stroke self-oscillators are possible |172|| . 

63 This is not so different from physics after all! 
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VIII. SUMMARY AND DISCUSSION 

Like the mythical perpetual motion machine, self-oscillation succeeds in driving itself, but does so in a way compat- 
ible with the known laws of physics. 64 Instances of self-oscillation, both useful and destructive, abound in mechanical 
engineering, music, biology, electronics, and medicine. Indeed, all technology ultimately depends on self-oscillation, 
since only a self-oscillator can turn a steady source of power into a regular cyclical motion. 

Sclf-oscillators, as distinct from forced and parametric resonators, can be readily identified by the fact that they 
sustain large, regular oscillations without an external rate having to be tuned to that frequency: the motion itself sets 
the phase of the driving force. We reviewed, for instance, how a violin string works as a self-oscillator, since increasing 
the velocity of the bow simply causes the same note to play more loudly, while the aeolian harp, on the other hand, 
is a forced resonator, which rings loudly only when the wind speed happens to give a Strouhal frequency of vortex 
shedding close to the fundamental tone of the string (or to one of its harmonics) . 

In his early mathematical modeling of the vocal chords, Airy obtained self-oscillation from a delayed component 
of the harmonic restoring force. More generally, self-oscillation can be understood as the result of a component of 
the driving force that is modulated in phase with the velocity of the displacement. This gives the device a negative 
damping, causing the amplitude to grow exponentially with time, until nonlinear effects become significant. 

Clocks and other common self-oscillators work by amplifying the device's vibration and feeding it back in order 
to drive the oscillator in phase with its velocity. The amplitude is limited by nonlinearities, as we saw explicitly for 
the van der Pol equation. In the regime of large negative damping, the van der Pol oscillator exhibits relaxation 
oscillation — in which the amplitude is fixed and the period is determined, not by the resonant frequency, but rather 
by nonlinear switching at thresholds — and it serves as a model of the beating heart and of neuronal firing, among 
other important phenomena. 

We showed that a linear system with more than one degree of freedom can self-oscillate, even if no single degree 
of freedom is negatively damped, as long as the couplings are not symmetric (which is possible only if the degrees 
of freedom describe perturbations about a non-stationary trajectory). We also characterized the limit cycles for the 
simplest nonlinear self-oscillator, the van der Pol equation, and illustrated the phenomena of entrainment, frequency 
demultiplication, and chaos when a periodic forcing term was added to that equation. 

All motors, which take a steady power input and produce a regularly alternating ouput, are self-oscillators and 
must waste some of the power, even if they could operate frictionlessly. We showed how this results from a general 
Carnot-Le Corbeiller theorem for the limit efficiency of dynamical frequency conversion. We also showed how the 
lossless halving of the frequency seen in a parametric resonator is not a violation of this theorem, but rather an 
instance of a geometric conversion: in the parametrically-driven pendulum with unit efficiency, the motor pulls up 
and down in phase with the vertical velocity of the mass, whose frequency is twice that of the pendulum's angular 
displacement. 

We then briefly reviewed the concept of a servomechanism, emphasizing both their intended operation, based 
on applying negative feedback to the action of a motor, as well as the possible unwanted self-oscillation about the 
intended trajectory. We worked out the Rayleigh criterion for thermoacoustic self-oscillators and applied it to several 
systems, including Cepheid variable stars. We discussed how lasers can be described as self-oscillating electromagnetic 
cavities, and discussed some ideas (both old and new) on describing the macroeconomic business cycle as a relaxation 
oscillation. 

Self-oscillation is both theoretically interesting and practically useful. Furthermore, it naturally connects with the 
mathematics and the history of control theory, since self-oscillation corresponds to the presence of positive feedback 
(and therefore of a dynamical instability). We see no excuse for the fact that the subject is hardly taught to physics 
students and that it remains, for most physicists, in the shadow of the notions of forced and parametric resonance. 

Three major open theoretical problems raised in this article obviously call for further investigation as well: the full 
characterization of the operation of self-oscillators (including clocks) from the point of view of the arrow of time in 
statistical mechanics, a general theory of the limits on the efficiency of frequency conversion that incorporates geo- 
metrical conversion and extends to both classical and quantum systems, and a better understanding of the mechanism 
of macroeconomic self-oscillations, including the business cycle. We also hope that greater conceptual clarity about 
the energetics of self-oscillation might motivate other useful investigations in both pure and applied physics. 



An amusing thought in this regard is that the cranks who insist on building overbalanced wheels and similar devices (see Il7ll ) are simply 
pursuing what is possible — indeed, very commonplace — by means which are already known to be unworkable. 
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FIG. 30: In a Josephson junction 256], two superconductors are separated by a thin insulator and kept at a constant voltage 
difference V by a battery. For V — a steady current J can tunnel across the insulator if the relative phase of the quantum 
states of the superconductors is neither nor n. For a fixed V > the current J alternates with angular frequency 2eV/h. 
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Appendix A: Josephson effect 

If two superconductors are separated by a thin insulator (a "Josephson junction," shown schematically in Fig. [30]) . 
a current 

J = J smS (Al) 

tunnels across the insulator, where Jo is the maximum current attainable (whose value characterizes the junction) and S 
is th e relative phase between the two wavefunctions that describe the collective quantum state of each superconductor. 
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For a constant voltage difference V between the two superconductors, the relative phase varies at a fixed rate 

where e is the electron's charge. Thus, when V = there will be a non-zero, direct current (DC) as long as the 
relative phase is neither nor tt. For V > the alternat ing c urrent (AC) will oscillate with angular frequency 2eV/h. 

Feynman beautifully reviews the Josephson effect in [282j | , where he shows that it is a general feature of the weak 
coupling of two coherent quantum states. Although the Josephson effect for V > satisfies Andronov's definition of 
self-oscillation as a macroscopic periodic motion (the AC across the Josephson junction) generated at the expense of 
a non-periodic source of energy (the battery that maintains the voltage difference between the superconductors) , it 
is qualitatively different from all other systems that we have discussed in this article, since its mechanism is strictly 
quantum-mechanical. This is obvious in the fact that the expression for the AC frequency as a function of V contains 
a factor of Planck's constant, h. 

Nonetheless, Pippard (who was Josephson's graduate advisor at the time of Josephson's discovery) offers a useful 
classical analogy in [283j |: Consider two coupled linear oscillators (for instance, two pendula joined by a spring). If 
they have the same frequency ui, then no energy will flow between them whe n the y move either in phase (8 = 0) or 
antiphase (8 — tt), since those are normal modes of the coupled system (see [l50j |). But if the phase takes another 
value, then energy will slosh back and forth between the oscillators. 

In the case of the Josephson effect, each superconductor is held at a constant energy by the battery, so for constant 
8 the flow of power between them is steady. If the oscillators have different frequencies wi,2, then the relative phase 
8 increases at a constant rate \w\ — u> 2 \, which by Eq. (|A1|) is also the angular frequency of the flow of power across 
the junction. 

What quantum mechanics adds to this classical picture is the conversion between frequencies and energies. Indeed, 
one may think of the DC Josephson effect for V = as an exchange of quanta of energy 

E = haj , (A3) 

where uj is the frequency of the oscillators. For V > the energies of the two superconductors are not matched and 
the exchange of Eq requires another process in which the energy of the whole system is adjusted by the emission of a 
quantum 

E' = K{u) X -u> 2 ) = H8 . (A4) 

Physically, this emission can only correspond to the change in energy of a superconducting Cooper pair (with charge 
2e) as it moves across the junction voltage, so that 

E' = 2eV , (A5) 

leading to the result of Eq. (|A2[) . 

Thus we see that the AC Josephson effect is more akin to quantum emission (in which a constant energy splitting 
AE is turned into r adia tion of frequency A.E/H) than it is like the other self-oscillations described in this article; on 
this point, see also |284j |. The Josephson AC is a macroscopic effect because a superconductor is in a macroscopic, 
coherent quantum state. Note as well that the AC across the junction turns on immediately when the external V is 
applied, without the exponential growth of small oscillations followed by an approach to a non-linear limit cycle that 
we saw in classical self-oscillators. 

On the other hand, the emission described by Eq. (|A4[) appears to be somewhat analogous to the "tail" loss that we 
argued had to accompany the classical interconversion of frequencies; see Sec. IVIC 11 Tha t fact that for oj\ = 2uj 2 we 
have 8 — u>2 suggests that lossless parametric down-conversion in quantum optics (see |285| ) might not be forbidden if 
uix/u>2 = 2. Whether this is so, and the possible connection to the classical arguments about "geometric conversion" 
made in Sees. IIIIFl and lVI C 11 deserve further investigation. 



Appendix B: Historical apercu 

The practical uses of self-oscillators are very ancient and, as we emphasized in Sec. IVI1 are an intrinsic aspect of 
human technology. But the theoretical question of how a steady source of power can produce and maintain a periodic 
motion seems not to have been posed in the context of Newtonian mechanics until the late 1820s, with the work of 
Robert Willis [25[ and G. B. Airy [24| on the operation of the human voice. 
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Even though Airy went on to become a long-serving Astronomer Royal, and Willis the Jacksonian Professor of 
Natural Philosophy at Cambridge, this early work was totally ignored. As far as we have been able to discover, 
only the anatomical component of Willis's research on the operation of the larynx attracted any attention, while 
Airy's paper was cited only by Henry Dircks, a self-taught engineer, in the context of his exhausti ve b ut eccentric 
investigation into the history of perpetual motion research [286], published in 1861. 65 Amusingly, in jl5l| Kelvin and 
Tait originally dismissed the possibility of linear self-oscillation as an unphysical perpetual motion (see Sec. IV Aj) . 

The the ory of self-oscillation begins anew with Maxwell's research into the stability of machines controlled by 
gove rnors [152]]. Ma xwell posed the problem as a mathematical puzzle, which was later solved in generality by Routh 
|l56| and Hurtwitz [l57j |. leading to a criterion for the stability of linear systems (see Sec. IV A 1[) . This line of 
investigation leads eventually to modern control theory, primarily via the work of engineers and mathematicians. Its 
focus has always been on the conditions for a servomechanism to keep to its intended trajectory. The connection to 
the problem of how the motor that drives such a mechanism can run in the first place was not pursued. If it had been, 
then perhaps the study of self-oscillation might have influenced the development of thermodynamics. As it was, the 
link was not made explicitly until 1936 by Le Corbeiller |l87l ] and his tentative ideas were then left unexplored (see 
Sec. EH- 66 

The first edition of Lord Rayleigh's Theory of Sound, whose two volumes were published in 1877 and 1878 respec- 
tively, contains no discussion of self-oscillation, except for the brief comment on the role of delayed action in the 
operation of Helmholtz's "fork- interrupter" (30j . and of velocity-dependent friction on the powering of the vibration 
of a violin string by the bow [67|. In his review of the second volume of Rayleigh's treatise, Helmholtz called attention 
to this deficiency: 

There is still an important chapter wanting, viz., that on the theory of reed-pipes, including the human 
voice [...] Altogether, the whole of this important class of motions, where oscillatory movem ents are kept 
up through a cause which acts constantly, deserves detailed theoretical consideration. [29 lj ] 

It might well have been Helmholtz's urging that led Rayleigh to his investigations into self-oscillation jlOlL |226| and 
parametric resonance [82| , which were eventually incorporated into the second edition of the Theory of Sound [2921 ] , 
published in 1894-1896. 67 

It is odd that Rayleigh's work on self-oscillation should have attracted so little attention for so long, even among 
acousticians, who have continued to cite Rayleigh's book even to this day, but not usually on that subject. 68 Van der 
Pol's first paper on electrical self-oscillation (98(, published in 1920, cites Rayleigh in a surprisingly narrow co ntext , 
considering that van der Pol's nonlinear equation of motion is equivalent to the one proposed by Rayleigh in [86l 1 10lj | . 

The work of van der Pol and his collaborators on self-oscillators attracted much attention, in the 1930s and beyond, 
from mathematicians, electrical engineers, physiologists, and even economists, but not from physicists. The research 
by Andronov (who coined the term "self-oscillation" ) and his associates in the Soviet Union was largely mathematical 
— in the tradition of Poincare and Lyapunov — and had i ts gr eatest impact in the theory of ordinary differential 
equations and in control engineering (see, e.g., (3. Il7ll [293l |294| ]). 

In particular, the issue of the flow of energy in self-oscillators seems to have received comparatively little attention. 
Initially, this might have been due to a widespread impression that the study of nonlinear equations of motion was 
a technically challenging problem unlikely to shed light of the sort of fundamental questions that might interest a 
theoretical physicist. What is perhaps more mysterious is that the explosion in interest in nonlinear dynamical systems 
that was engendered by the advent of fast and cheap digital computers and by the ascendance of chaos theory after 
the 1970s should have largely failed to call the attention of physicists back to these questions, except in the narrow 
context of the mathematical characterization of limit cycles and their entrainment (see Sec. IV B"|) . 



Dircks cited Airy as a last-minute addition to the manuscri pt an d without evidence of understanding his argument; he dropped all 
reference to Airy from the "second series," published in 1870 287] . It was presumably through Dircks's book that R. T. Gould learned 
of the existence of Airy's paper (see Sec. Ill Ct . 

It is intriguing that the you ng Willard Gibbs should have investigated the efficie ncy of power transfer in gears I200H (see Sec. IVI C 21 
and hydraulic turbines |2SSj . as well as the stability of steam engine governors [289j (see Sec. IV At . before turning his attention to 
thermodynamics in the 1870s. Gibbs's retiring personality and the highly abstract and parsimonious style of his writing make it difficult 
to determine to what extent his early work in engineering motivated or influenced his mature research on thermodynamics. Sec 290] 
for a discussion of this question. 

Even though Helmholtz [6lll and Kelvin Iti'J had worked out the instability of the surface of separation between two fluid layers with a 
sufficient relative velocity (see Sec. IIII C\ . thus explaining the self-oscillation of the waves formed by the wind on the surface of the sea 
and other bodies of water, the connection was not made by either of them to "maintained oscillators" such as clocks and wind musical 
instruments. 

It is also telling that Eddington should have had to rediscover Rayleigh's criterion when he became interested in the thermodynamics 
of the pulsation of Cepheid variables (see Sec. I VII B 4|l . 
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Appendix C: Note on sources 



In this review of self-oscillation, we have made an effort to give all relevant references, both to the original research 
reports and to textbooks. For a physics student wishing to learn the subject systematically, further guidance is in 
order. 

Lord Rayleigh's justly celebrated Theory of Sound [295j covers almost all topics of importance in mechanical 
vibrations and acoustics. Unfortunately, the age, length, and organization of Rayleigh's treatise may limit its usefulness 
for modern students. Note that, as explained in Appendix [Bj the theory of self-oscillation (which he calls "maintained 
vibration") is covered in the second edition, but not in the first. 

At this time, there does not appear to be any textbook treatment of sel f-oscillat ion suitable for undergraduate 
physics students, and even leading contemporary textbooks in acoustics (e.g., [296ll297| l ignore the subject alt oget her. 
Perhaps the best introductory sources for physics students are the review of "self-sustaining oscillators" in |298l |. as 
well as the pedagogical articles by Billah and Scalan [5l|, and by Green and Unruh [33| on the Tacoma Narrows 
bridge collapse, all of which make a clear conceptual distinction between forced resonance and self-oscillation. Also, 
as noted in Sec. I VII B 21 the Rijke tube provides an impressive demonstration of self-oscillation that can be easily 
conduct ed d uring a classroom lecture. (Pippard gives a clear and complete explanation of the operation of the Rijke 
tube in (22^ .) 

Self-oscillatio n is covered by Sargent, Scully, and Lamb in 105] (where it is called "sustained " os cillation), by 
Pippard in [87l Il24| (where it is called "maintained" oscillation), and by Fletcher and Rossing in |299j (where it is 
called "self-excited" oscillation). These treatments all use the method of slowly varying amplitud e and phase (or 
"method of averaging" ) , deve lope d by van der Pol [l06j and by Krylov and Bogolyubov |300L l30ll ] for the study of 
nonlinear vibrations; see also [302j |. 

Selected Papers on Mathematical Trends in Control Theory |303| ] repr oduces seve ral i mportant prima ry documents 
dire ctly related to self-oscillation, including the work of Maxwell jl52| . Hurwitz jl57l |. Nyquist 202), and van der 
Pol [l22j |. each prefaced by a short explanation of its significance. It also includes Bateman's thorough historico- 
mathematical review of linear stability analysis [35| , followed by a b rief o verview of the work of Poincare and Lyapunov 
on the stability of the trajectories of nonli near dynamical systems |l70l | (see Sec. IV B 5|) . For a modern and thorough 
textbook treatment of control theory, see |304j . 

The review articles written in the 1930s by van de Pol |l06| and Le Corbeiller (96l . ll87l | are still worth reading. Als o 
valuable is the brief overview presented by Le Corbeiller before the first meeting of the Eco nom etric Society [258j |. 
convened at Lausanne in 1931, from which we quoted in Sec. IVII D] (Unfortunately, 96] and [258] are only available 
in French.) Groszkowski compiled a very compre hensi ve bibliography of the research on self-oscillation published up 
to 1962, with emphasis on electrical engineering 305]. It is rather unfortunate that those works focus on electrical 
oscillators with vacuum tube amplifiers, which are now obsolete. 

Soviet scientists A. A. Andronov, A. A. Vitt, and S. E. Khaikin produced one of the fullest available accounts of 
self-oscillation in the second edition of their monumental Theory of oscillators. This is available in English in an 
edition revised and abridged by Wilfred Fishwick in 1966 [lj. (The first edition appeared in Russian in 1937 without 
any acknowledgement of Vitt's contribution, as Vitt had bee n imprisoned and executed during Stalin's Great Purge 
[HIH) V. I. Arnol'd's Ordinary Differential Equations [293j ] admirably combines mathematical rigor with physical 
intuition and can serve as an excellent point of contact with the mathematical and engineering literature based on 
Poincare's "qualitative theory of differential equations," Lyapunov stability, and differential topology (see Sec. IV B 5|) . 
Nonlinear Oscillations, by Nayfeh and Mook, is a standard modern textbook on the subject for engineers 306], m 
which self-oscillators are identified as "self-sustaining systems." 

Norbert Wiener's groundbreaking Cybernetics [307} offers a unique and fascinating perspective on some of the 
concepts covered in this article, though it is hardly a systematic treatment and appears to have been most influential 
in disciplines other than physic s. A . B. Pippard presented another interesting and idiosyncratic treatment of these 
topics in Response and stability 308]. The description of lasers as self-oscillators by Lamb and his collaborators, cited 
in Sec. IVII CI are also pedagogically valuable. 

Many authors have written books for lay readers on aspects of the nonlinear theory of dynamical systems, especially 
chaos theory. Steven Strogatz's Sync |l42j emphasizes some of the topics covered in this article, particularly about 
entrainment and chaos in relaxation oscillators (see Sees. HVEl IIVFI and I V B 3|) . 
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